PROJECT (sourcing_v2)
SPIDER (auto1.fr)
2026-03-30 11:05:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 11:05:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 11:05:04 [auto1.fr] INFO: Batch mode enabled: batch 2/4
2026-03-30 11:05:04 [auto1.fr] INFO: Starting spider auto1.fr
2026-03-30 11:05:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 11:05:04 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 11:05:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 11:05:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 11:05:04 [scrapy.extensions.telnet] INFO: Telnet Password: 0d6ca3a884c05b89
2026-03-30 11:05:04 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-30 11:05:04 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.fr/task_13_2026-03-30T11_05_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-30 11:05:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 11:05:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 11:05:04 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 11:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 11:05:04 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 11:05:04 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2117
2026-03-30 11:05:04 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 11:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 11:05:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 11:05:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 11:05:05 [scrapy.core.engine] INFO: Spider opened
2026-03-30 11:05:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 11:05:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-30 11:05:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-30 11:05:05 [scrapy-playwright] INFO: Starting download handler
2026-03-30 11:05:05 [scrapy-playwright] INFO: Starting download handler
2026-03-30 11:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 11:06:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 11:07:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 11:07:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 11:07:19 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.883(s), this was the 1st time calling it.
2026-03-30 11:07:19 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.11498069032799 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:07:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 11:07:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 11:07:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 11:07:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:05 [scrapy.extensions.logstats] INFO: Crawled 3 pages (at 3 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 11:08:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 150MiB
2026-03-30 11:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 11:08:59 [auto1.fr] INFO: Channel: 24h | Page: 0 | totalHits: 5532 | hits on page: 40
2026-03-30 11:08:59 [auto1.fr] INFO: Found listing with ID: BJ69793
2026-03-30 11:08:59 [auto1.fr] INFO: Found listing with ID: RK77632
2026-03-30 11:08:59 [auto1.fr] INFO: Found listing with ID: MG57565
2026-03-30 11:08:59 [auto1.fr] INFO: Found listing with ID: CM40964
2026-03-30 11:08:59 [auto1.fr] INFO: Found listing with ID: VN88845
2026-03-30 11:08:59 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-30 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN88845%27 HTTP/1.1" 200 None
2026-03-30 11:08:59 [auto1.fr] INFO: Scrape type for VN88845: 1
2026-03-30 11:08:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:59 [auto1.fr] INFO: Found listing with ID: ZB65239
2026-03-30 11:08:59 [auto1.fr] INFO: Found listing with ID: KV40050
2026-03-30 11:08:59 [auto1.fr] INFO: Found listing with ID: HK32331
2026-03-30 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK32331%27 HTTP/1.1" 200 None
2026-03-30 11:08:59 [auto1.fr] INFO: Scrape type for HK32331: 1
2026-03-30 11:08:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:59 [auto1.fr] INFO: Found listing with ID: AM96995
2026-03-30 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM96995%27 HTTP/1.1" 200 None
2026-03-30 11:08:59 [auto1.fr] INFO: Scrape type for AM96995: 1
2026-03-30 11:08:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:59 [auto1.fr] INFO: Found listing with ID: HT52883
2026-03-30 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT52883%27 HTTP/1.1" 200 None
2026-03-30 11:08:59 [auto1.fr] INFO: Scrape type for HT52883: 2
2026-03-30 11:08:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99591914-fb03-58b7-9236-893afc944576 with identifier: HT52883
2026-03-30 11:08:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99591914-fb03-58b7-9236-893afc944576 with scrape type 2
2026-03-30 11:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99591914-fb03-58b7-9236-893afc944576 with scrape type 2
2026-03-30 11:08:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 99591914-fb03-58b7-9236-893afc944576, identifier: HT52883
2026-03-30 11:08:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 99591914-fb03-58b7-9236-893afc944576 with identifier: HT52883
2026-03-30 11:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:08:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 11:08:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:08:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 11:09:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 99591914-fb03-58b7-9236-893afc944576 with identifier: HT52883
2026-03-30 11:09:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 99591914-fb03-58b7-9236-893afc944576 with identifier: HT52883 to the API
2026-03-30 11:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:44:13Z',
'fuel_type': 'petrol',
'id': '99591914-fb03-58b7-9236-893afc944576',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT52883',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 105107,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-07',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2018}
2026-03-30 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT52883%27 HTTP/1.1" 200 None
2026-03-30 11:09:00 [auto1.fr] INFO: Saving data for HT52883: {'auction_closing_time': 1774971853.0, 'created_time': 1773674280.3435, 'last_price_update_time': 1774868940.429386}
2026-03-30 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HT52883') HTTP/1.1" 204 0
2026-03-30 11:09:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:00 [auto1.fr] INFO: Found listing with ID: FH12619
2026-03-30 11:09:00 [auto1.fr] INFO: Found listing with ID: DX08652
2026-03-30 11:09:00 [auto1.fr] INFO: Found listing with ID: YY12321
2026-03-30 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY12321%27 HTTP/1.1" 200 None
2026-03-30 11:09:00 [auto1.fr] INFO: Scrape type for YY12321: 1
2026-03-30 11:09:00 [auto1.fr] INFO: Found listing with ID: BZ11243
2026-03-30 11:09:00 [auto1.fr] INFO: Found listing with ID: MC30629
2026-03-30 11:09:00 [auto1.fr] INFO: Found listing with ID: FA81163
2026-03-30 11:09:00 [auto1.fr] INFO: Found listing with ID: KL53133
2026-03-30 11:09:00 [auto1.fr] INFO: Found listing with ID: LD88363
2026-03-30 11:09:00 [auto1.fr] INFO: Found listing with ID: AE60263
2026-03-30 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE60263%27 HTTP/1.1" 200 None
2026-03-30 11:09:00 [auto1.fr] INFO: Scrape type for AE60263: 2
2026-03-30 11:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cae3a033-1435-5dfe-b5af-dbcca5fcb5f0 with identifier: AE60263
2026-03-30 11:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cae3a033-1435-5dfe-b5af-dbcca5fcb5f0 with scrape type 2
2026-03-30 11:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cae3a033-1435-5dfe-b5af-dbcca5fcb5f0 with scrape type 2
2026-03-30 11:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cae3a033-1435-5dfe-b5af-dbcca5fcb5f0, identifier: AE60263
2026-03-30 11:09:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cae3a033-1435-5dfe-b5af-dbcca5fcb5f0 with identifier: AE60263
2026-03-30 11:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:09:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 11:09:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cae3a033-1435-5dfe-b5af-dbcca5fcb5f0 with identifier: AE60263
2026-03-30 11:09:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cae3a033-1435-5dfe-b5af-dbcca5fcb5f0 with identifier: AE60263 to the API
2026-03-30 11:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:37:58Z',
'fuel_type': 'diesel',
'id': 'cae3a033-1435-5dfe-b5af-dbcca5fcb5f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE60263',
'listing': 'auction',
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 426557,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-05',
'seller_name': None,
'title': 'Citroen Jumpy 2.0 Blue-HDi Driver M',
'transmission': 'manual',
'trim': 'Driver M',
'year': 2019}
2026-03-30 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE60263%27 HTTP/1.1" 200 None
2026-03-30 11:09:01 [auto1.fr] INFO: Saving data for AE60263: {'auction_closing_time': 1774971478.0, 'created_time': 1774264859.029013, 'last_price_update_time': 1774868941.044944}
2026-03-30 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AE60263') HTTP/1.1" 204 0
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: HJ00300
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: PU50032
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: RA05158
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: JK35304
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: MN44721
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: MD74717
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: ZK76160
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: NN04652
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: VZ81216
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: TC68759
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: CW53628
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: DC44868
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: UW53663
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: US33536
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: WD54584
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: YW95936
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: VS72770
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: RD35407
2026-03-30 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD35407%27 HTTP/1.1" 200 None
2026-03-30 11:09:01 [auto1.fr] INFO: Scrape type for RD35407: 2
2026-03-30 11:09:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 689f671e-3a28-58a2-93c2-a481fe32e587 with identifier: RD35407
2026-03-30 11:09:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 689f671e-3a28-58a2-93c2-a481fe32e587 with scrape type 2
2026-03-30 11:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 689f671e-3a28-58a2-93c2-a481fe32e587 with scrape type 2
2026-03-30 11:09:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 689f671e-3a28-58a2-93c2-a481fe32e587, identifier: RD35407
2026-03-30 11:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 689f671e-3a28-58a2-93c2-a481fe32e587 with identifier: RD35407
2026-03-30 11:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 689f671e-3a28-58a2-93c2-a481fe32e587 with identifier: RD35407
2026-03-30 11:09:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 689f671e-3a28-58a2-93c2-a481fe32e587 with identifier: RD35407 to the API
2026-03-30 11:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:28:04Z',
'fuel_type': 'petrol',
'id': '689f671e-3a28-58a2-93c2-a481fe32e587',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD35407',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 99012,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-23',
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2018}
2026-03-30 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD35407%27 HTTP/1.1" 200 None
2026-03-30 11:09:01 [auto1.fr] INFO: Saving data for RD35407: {'auction_closing_time': 1774970884.0, 'created_time': 1774253134.506948, 'last_price_update_time': 1774868941.610764}
2026-03-30 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RD35407') HTTP/1.1" 204 0
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: VN56333
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: PR46481
2026-03-30 11:09:01 [auto1.fr] INFO: Found listing with ID: WK96071
2026-03-30 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WK96071%27 HTTP/1.1" 200 None
2026-03-30 11:09:01 [auto1.fr] INFO: Scrape type for WK96071: 1
2026-03-30 11:09:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VN88845/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY12321/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AM96995/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:05 [scrapy.extensions.logstats] INFO: Crawled 7 pages (at 4 pages/min), scraped 3 items (at 3 items/min)
2026-03-30 11:09:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 153MiB
2026-03-30 11:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VN88845> (referer: https://www.auto1.com/v1/car-details-view/VN88845/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ede79dcb-6f4d-51aa-bf17-fab514ec9bfe with identifier: VN88845
2026-03-30 11:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ede79dcb-6f4d-51aa-bf17-fab514ec9bfe with scrape type 1
2026-03-30 11:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ede79dcb-6f4d-51aa-bf17-fab514ec9bfe
2026-03-30 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F2b%252F102b9c1db9aecd73352ba0a69024fd2a%252Fpa%252FVN88845_a7277d02926ea043cb7533a53b06016f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_a7277d02926ea043cb7533a53b06016f.jpg not downloaded yet
2026-03-30 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F2b%252F102b9c1db9aecd73352ba0a69024fd2a%252Fpa%252FVN88845_21f59110ff6a4187d86ca4a362778407.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_21f59110ff6a4187d86ca4a362778407.jpg not downloaded yet
2026-03-30 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F2b%252F102b9c1db9aecd73352ba0a69024fd2a%252Fpa%252FVN88845_78baa1b55fc87bba3be81dc7a128ae93.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_78baa1b55fc87bba3be81dc7a128ae93.jpg not downloaded yet
2026-03-30 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F2b%252F102b9c1db9aecd73352ba0a69024fd2a%252Fpa%252FVN88845_80f91a913511424ce8cda677dd94de89.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_80f91a913511424ce8cda677dd94de89.jpg not downloaded yet
2026-03-30 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F2b%252F102b9c1db9aecd73352ba0a69024fd2a%252Fpa%252FVN88845_d7297c40d5dc9ce921d31b8c72af0081.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_d7297c40d5dc9ce921d31b8c72af0081.jpg not downloaded yet
2026-03-30 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F2b%252F102b9c1db9aecd73352ba0a69024fd2a%252Fpa%252FVN88845_684fbbc10d6784e7c185137b9cffb230.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_684fbbc10d6784e7c185137b9cffb230.jpg not downloaded yet
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F2b%252F102b9c1db9aecd73352ba0a69024fd2a%252Fpa%252FVN88845_77b3cddf03b67b1b486e67ba489ff440.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_77b3cddf03b67b1b486e67ba489ff440.jpg not downloaded yet
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F2b%252F102b9c1db9aecd73352ba0a69024fd2a%252Fpa%252FVN88845_9e63b27040f710cc81962cd3beadadfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_9e63b27040f710cc81962cd3beadadfc.jpg not downloaded yet
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F2b%252F102b9c1db9aecd73352ba0a69024fd2a%252Fpa%252FVN88845_e17c71584ab5e9ee3175095af9d710cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_e17c71584ab5e9ee3175095af9d710cf.jpg not downloaded yet
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F2b%252F102b9c1db9aecd73352ba0a69024fd2a%252Fpa%252FVN88845_196b584140ee4804dfefa1dec967ca32.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_196b584140ee4804dfefa1dec967ca32.jpg not downloaded yet
2026-03-30 11:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_78baa1b55fc87bba3be81dc7a128ae93.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_a7277d02926ea043cb7533a53b06016f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_d7297c40d5dc9ce921d31b8c72af0081.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_e17c71584ab5e9ee3175095af9d710cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_80f91a913511424ce8cda677dd94de89.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_77b3cddf03b67b1b486e67ba489ff440.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_9e63b27040f710cc81962cd3beadadfc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a8ae010>
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2117
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ede79dcb-6f4d-51aa-bf17-fab514ec9bfe/ede79dcb-6f4d-51aa-bf17-fab514ec9bfe_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F2b%252F102b9c1db9aecd73352ba0a69024fd2a%252Fpa%252FVN88845_78baa1b55fc87bba3be81dc7a128ae93.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_78baa1b55fc87bba3be81dc7a128ae93.jpg saved to cache
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ede79dcb-6f4d-51aa-bf17-fab514ec9bfe
2026-03-30 11:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_684fbbc10d6784e7c185137b9cffb230.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_21f59110ff6a4187d86ca4a362778407.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_196b584140ee4804dfefa1dec967ca32.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738685190>
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ede79dcb-6f4d-51aa-bf17-fab514ec9bfe/ede79dcb-6f4d-51aa-bf17-fab514ec9bfe_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F2b%252F102b9c1db9aecd73352ba0a69024fd2a%252Fpa%252FVN88845_a7277d02926ea043cb7533a53b06016f.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_a7277d02926ea043cb7533a53b06016f.jpg saved to cache
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ede79dcb-6f4d-51aa-bf17-fab514ec9bfe
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383b28d0>
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ede79dcb-6f4d-51aa-bf17-fab514ec9bfe/ede79dcb-6f4d-51aa-bf17-fab514ec9bfe_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F2b%252F102b9c1db9aecd73352ba0a69024fd2a%252Fpa%252FVN88845_d7297c40d5dc9ce921d31b8c72af0081.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_d7297c40d5dc9ce921d31b8c72af0081.jpg saved to cache
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ede79dcb-6f4d-51aa-bf17-fab514ec9bfe
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383bf550>
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ede79dcb-6f4d-51aa-bf17-fab514ec9bfe/ede79dcb-6f4d-51aa-bf17-fab514ec9bfe_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F2b%252F102b9c1db9aecd73352ba0a69024fd2a%252Fpa%252FVN88845_e17c71584ab5e9ee3175095af9d710cf.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_e17c71584ab5e9ee3175095af9d710cf.jpg saved to cache
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ede79dcb-6f4d-51aa-bf17-fab514ec9bfe
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383b2ed0>
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ede79dcb-6f4d-51aa-bf17-fab514ec9bfe/ede79dcb-6f4d-51aa-bf17-fab514ec9bfe_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F2b%252F102b9c1db9aecd73352ba0a69024fd2a%252Fpa%252FVN88845_80f91a913511424ce8cda677dd94de89.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_80f91a913511424ce8cda677dd94de89.jpg saved to cache
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ede79dcb-6f4d-51aa-bf17-fab514ec9bfe
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383c2710>
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ede79dcb-6f4d-51aa-bf17-fab514ec9bfe/ede79dcb-6f4d-51aa-bf17-fab514ec9bfe_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F2b%252F102b9c1db9aecd73352ba0a69024fd2a%252Fpa%252FVN88845_77b3cddf03b67b1b486e67ba489ff440.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_77b3cddf03b67b1b486e67ba489ff440.jpg saved to cache
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ede79dcb-6f4d-51aa-bf17-fab514ec9bfe
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383beed0>
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ede79dcb-6f4d-51aa-bf17-fab514ec9bfe/ede79dcb-6f4d-51aa-bf17-fab514ec9bfe_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F2b%252F102b9c1db9aecd73352ba0a69024fd2a%252Fpa%252FVN88845_9e63b27040f710cc81962cd3beadadfc.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_9e63b27040f710cc81962cd3beadadfc.jpg saved to cache
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ede79dcb-6f4d-51aa-bf17-fab514ec9bfe
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385321d0>
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ede79dcb-6f4d-51aa-bf17-fab514ec9bfe/ede79dcb-6f4d-51aa-bf17-fab514ec9bfe_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F2b%252F102b9c1db9aecd73352ba0a69024fd2a%252Fpa%252FVN88845_684fbbc10d6784e7c185137b9cffb230.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_684fbbc10d6784e7c185137b9cffb230.jpg saved to cache
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ede79dcb-6f4d-51aa-bf17-fab514ec9bfe
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073853b990>
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ede79dcb-6f4d-51aa-bf17-fab514ec9bfe/ede79dcb-6f4d-51aa-bf17-fab514ec9bfe_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F2b%252F102b9c1db9aecd73352ba0a69024fd2a%252Fpa%252FVN88845_21f59110ff6a4187d86ca4a362778407.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_21f59110ff6a4187d86ca4a362778407.jpg saved to cache
2026-03-30 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ede79dcb-6f4d-51aa-bf17-fab514ec9bfe
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0739412fd0>
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ede79dcb-6f4d-51aa-bf17-fab514ec9bfe/ede79dcb-6f4d-51aa-bf17-fab514ec9bfe_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F2b%252F102b9c1db9aecd73352ba0a69024fd2a%252Fpa%252FVN88845_196b584140ee4804dfefa1dec967ca32.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_196b584140ee4804dfefa1dec967ca32.jpg saved to cache
2026-03-30 11:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ede79dcb-6f4d-51aa-bf17-fab514ec9bfe
2026-03-30 11:09:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ede79dcb-6f4d-51aa-bf17-fab514ec9bfe, skipping ID generation
2026-03-30 11:09:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ede79dcb-6f4d-51aa-bf17-fab514ec9bfe with scrape type 1
2026-03-30 11:09:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ede79dcb-6f4d-51aa-bf17-fab514ec9bfe sending to next pipeline
2026-03-30 11:09:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ede79dcb-6f4d-51aa-bf17-fab514ec9bfe, identifier: VN88845
2026-03-30 11:09:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ede79dcb-6f4d-51aa-bf17-fab514ec9bfe with identifier: VN88845
2026-03-30 11:09:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ede79dcb-6f4d-51aa-bf17-fab514ec9bfe with identifier: VN88845
2026-03-30 11:09:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ede79dcb-6f4d-51aa-bf17-fab514ec9bfe with identifier: VN88845 to the API
2026-03-30 11:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_196b584140ee4804dfefa1dec967ca32.jpg>
{'auction_title': '',
'c_o_2_emission_value': 162,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '3.0L',
'engine_horse_power': 313,
'expiration_date': '2026-03-31T15:25:54Z',
'fuel_type': 'diesel',
'id': 'ede79dcb-6f4d-51aa-bf17-fab514ec9bfe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN88845',
'listing': 'auction',
'location': 'FR, Chambray-Lès-Tours',
'make': 'BMW',
'model': 'X3',
'odometer': 115047,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ede79dcb-6f4d-51aa-bf17-fab514ec9bfe/ede79dcb-6f4d-51aa-bf17-fab514ec9bfe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82642,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_a7277d02926ea043cb7533a53b06016f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ede79dcb-6f4d-51aa-bf17-fab514ec9bfe/ede79dcb-6f4d-51aa-bf17-fab514ec9bfe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78369,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_21f59110ff6a4187d86ca4a362778407.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ede79dcb-6f4d-51aa-bf17-fab514ec9bfe/ede79dcb-6f4d-51aa-bf17-fab514ec9bfe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76176,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_78baa1b55fc87bba3be81dc7a128ae93.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ede79dcb-6f4d-51aa-bf17-fab514ec9bfe/ede79dcb-6f4d-51aa-bf17-fab514ec9bfe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56904,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_80f91a913511424ce8cda677dd94de89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ede79dcb-6f4d-51aa-bf17-fab514ec9bfe/ede79dcb-6f4d-51aa-bf17-fab514ec9bfe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74601,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_d7297c40d5dc9ce921d31b8c72af0081.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ede79dcb-6f4d-51aa-bf17-fab514ec9bfe/ede79dcb-6f4d-51aa-bf17-fab514ec9bfe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77976,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_684fbbc10d6784e7c185137b9cffb230.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ede79dcb-6f4d-51aa-bf17-fab514ec9bfe/ede79dcb-6f4d-51aa-bf17-fab514ec9bfe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_77b3cddf03b67b1b486e67ba489ff440.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ede79dcb-6f4d-51aa-bf17-fab514ec9bfe/ede79dcb-6f4d-51aa-bf17-fab514ec9bfe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_9e63b27040f710cc81962cd3beadadfc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ede79dcb-6f4d-51aa-bf17-fab514ec9bfe/ede79dcb-6f4d-51aa-bf17-fab514ec9bfe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82300,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_e17c71584ab5e9ee3175095af9d710cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ede79dcb-6f4d-51aa-bf17-fab514ec9bfe/ede79dcb-6f4d-51aa-bf17-fab514ec9bfe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72670,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/2b/102b9c1db9aecd73352ba0a69024fd2a/pa/VN88845_196b584140ee4804dfefa1dec967ca32.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-03-25',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 35d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-30 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN88845%27 HTTP/1.1" 200 None
2026-03-30 11:09:08 [auto1.fr] INFO: Saving data for VN88845: {'created_time': 1774868948.587186, 'last_price_update_time': 1774868948.587198, 'auction_closing_time': 1774970754.0}
2026-03-30 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VN88845') HTTP/1.1" 204 0
2026-03-30 11:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK32331/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WK96071/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK32331> (referer: https://www.auto1.com/v1/car-details-view/HK32331/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7 with identifier: HK32331
2026-03-30 11:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7 with scrape type 1
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F31%252F9b3177a64a9bcb525065121deb7aa072%252Fpa%252FHK32331_b27957aa513d940bdeaff8c6c3ea2305.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_b27957aa513d940bdeaff8c6c3ea2305.jpg already downloaded
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F31%252F9b3177a64a9bcb525065121deb7aa072%252Fpa%252FHK32331_4cd6281eb1c974734e4259de7ed9ea39.png%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_4cd6281eb1c974734e4259de7ed9ea39.png already downloaded
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F31%252F9b3177a64a9bcb525065121deb7aa072%252Fpa%252FHK32331_80bd3d51216737ddc34671b879a4bb8a.png%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_80bd3d51216737ddc34671b879a4bb8a.png already downloaded
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F31%252F9b3177a64a9bcb525065121deb7aa072%252Fpa%252FHK32331_4a0338564f86120469d6c5ce1a58c0b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_4a0338564f86120469d6c5ce1a58c0b5.jpg already downloaded
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F31%252F9b3177a64a9bcb525065121deb7aa072%252Fpa%252FHK32331_f96f55a15c609a656b82d0f8369c3432.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_f96f55a15c609a656b82d0f8369c3432.jpg already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F31%252F9b3177a64a9bcb525065121deb7aa072%252Fpa%252FHK32331_d83a00c50500fe9e656916c93e32ae83.png%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_d83a00c50500fe9e656916c93e32ae83.png already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F31%252F9b3177a64a9bcb525065121deb7aa072%252Fpa%252FHK32331_73b52a21a2070982b58d507c9b14d996.png%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_73b52a21a2070982b58d507c9b14d996.png already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F31%252F9b3177a64a9bcb525065121deb7aa072%252Fpa%252FHK32331_8056d1fe56924a7319f73e6d5c7d34ed.png%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_8056d1fe56924a7319f73e6d5c7d34ed.png already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F31%252F9b3177a64a9bcb525065121deb7aa072%252Fpa%252FHK32331_8c79e6d917fbe0d6ff6cc8302727e58b.png%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_8c79e6d917fbe0d6ff6cc8302727e58b.png already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F31%252F9b3177a64a9bcb525065121deb7aa072%252Fpa%252FHK32331_9760199c7f4eeccede060afc717462f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_9760199c7f4eeccede060afc717462f4.jpg already downloaded
2026-03-30 11:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7, identifier: HK32331
2026-03-30 11:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7 with identifier: HK32331
2026-03-30 11:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7 with identifier: HK32331
2026-03-30 11:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7 with identifier: HK32331 to the API
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HK32331>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:35:58Z',
'fuel_type': 'diesel',
'id': 'd0459a5d-0cb8-5732-8a5a-af48b5b7d1c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK32331',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Peugeot',
'model': 'Partner',
'odometer': 54862,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 12,
'photo_urls': ['https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_b27957aa513d940bdeaff8c6c3ea2305.jpg',
'https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_4cd6281eb1c974734e4259de7ed9ea39.png',
'https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_80bd3d51216737ddc34671b879a4bb8a.png',
'https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_4a0338564f86120469d6c5ce1a58c0b5.jpg',
'https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_f96f55a15c609a656b82d0f8369c3432.jpg',
'https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_d83a00c50500fe9e656916c93e32ae83.png',
'https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_73b52a21a2070982b58d507c9b14d996.png',
'https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_8056d1fe56924a7319f73e6d5c7d34ed.png',
'https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_8c79e6d917fbe0d6ff6cc8302727e58b.png',
'https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_9760199c7f4eeccede060afc717462f4.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7/d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_b27957aa513d940bdeaff8c6c3ea2305.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7/d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_4cd6281eb1c974734e4259de7ed9ea39.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7/d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_80bd3d51216737ddc34671b879a4bb8a.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7/d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_4a0338564f86120469d6c5ce1a58c0b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7/d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74064,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_f96f55a15c609a656b82d0f8369c3432.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7/d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7_image_5.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_d83a00c50500fe9e656916c93e32ae83.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7/d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_73b52a21a2070982b58d507c9b14d996.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7/d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_8056d1fe56924a7319f73e6d5c7d34ed.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7/d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7_image_8.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_8c79e6d917fbe0d6ff6cc8302727e58b.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7/d0459a5d-0cb8-5732-8a5a-af48b5b7d1c7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/31/9b3177a64a9bcb525065121deb7aa072/pa/HK32331_9760199c7f4eeccede060afc717462f4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-24',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot Partner 1.6 Blue-HDi L2 Cabine Approfondie',
'transmission': 'manual',
'trim': 'L2 Cabine Approfondie',
'year': 2019}
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK32331%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [auto1.fr] INFO: Saving data for HK32331: {'created_time': 1774868951.538486, 'last_price_update_time': 1774868951.5385, 'auction_closing_time': 1774971358.0}
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HK32331') HTTP/1.1" 204 0
2026-03-30 11:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:18 [auto1.fr] INFO: Channel: 24h | Page: 1 | totalHits: 5534 | hits on page: 40
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: HL85627
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL85627%27 HTTP/1.1" 200 None
2026-03-30 11:09:18 [auto1.fr] INFO: Scrape type for HL85627: 1
2026-03-30 11:09:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: NY25826
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: BJ69793
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: RK77632
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: MG57565
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: CM40964
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: VN88845
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN88845%27 HTTP/1.1" 200 None
2026-03-30 11:09:18 [auto1.fr] INFO: Scrape type for VN88845: 0
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: ZB65239
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: KV40050
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: HK32331
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK32331%27 HTTP/1.1" 200 None
2026-03-30 11:09:18 [auto1.fr] INFO: Scrape type for HK32331: 0
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: AM96995
2026-03-30 11:09:18 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/AM96995/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 11:09:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: HT52883
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT52883%27 HTTP/1.1" 200 None
2026-03-30 11:09:18 [auto1.fr] INFO: Scrape type for HT52883: 0
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: FH12619
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: DX08652
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: YY12321
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: BZ11243
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: MC30629
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: FA81163
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: KL53133
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: LD88363
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: AE60263
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE60263%27 HTTP/1.1" 200 None
2026-03-30 11:09:18 [auto1.fr] INFO: Scrape type for AE60263: 0
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: HJ00300
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: PU50032
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: RA05158
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: JK35304
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: MN44721
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: MD74717
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: ZK76160
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: NN04652
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: VZ81216
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: TC68759
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: CW53628
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: DC44868
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: UW53663
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: US33536
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: WD54584
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: YW95936
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: VS72770
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: RD35407
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD35407%27 HTTP/1.1" 200 None
2026-03-30 11:09:18 [auto1.fr] INFO: Scrape type for RD35407: 0
2026-03-30 11:09:18 [auto1.fr] INFO: Found listing with ID: VN56333
2026-03-30 11:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL85627/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WK96071> (referer: https://www.auto1.com/v1/car-details-view/WK96071/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80e3b9ad-3b69-5780-9150-818d76bf6600 with identifier: WK96071
2026-03-30 11:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80e3b9ad-3b69-5780-9150-818d76bf6600 with scrape type 1
2026-03-30 11:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80e3b9ad-3b69-5780-9150-818d76bf6600
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbe%252F28beb34c05d2519182d05ef82db32d9d%252Fpa%252FWK96071_a0cf873b9a75a3160ff8e99ae454ef70.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_a0cf873b9a75a3160ff8e99ae454ef70.jpg not downloaded yet
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbe%252F28beb34c05d2519182d05ef82db32d9d%252Fpa%252FWK96071_60485a2edb8d93af7386ac5b16c62285.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_60485a2edb8d93af7386ac5b16c62285.jpg not downloaded yet
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbe%252F28beb34c05d2519182d05ef82db32d9d%252Fpa%252FWK96071_2105efd7c1a3bc546d7b7a23e864c827.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_2105efd7c1a3bc546d7b7a23e864c827.jpg not downloaded yet
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbe%252F28beb34c05d2519182d05ef82db32d9d%252Fpa%252FWK96071_64bd0633136b1620990eb1b5fa4e8c2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_64bd0633136b1620990eb1b5fa4e8c2d.jpg not downloaded yet
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbe%252F28beb34c05d2519182d05ef82db32d9d%252Fpa%252FWK96071_724c4c6a1e86b8842d747af15d8c7dc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_724c4c6a1e86b8842d747af15d8c7dc4.jpg not downloaded yet
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbe%252F28beb34c05d2519182d05ef82db32d9d%252Fpa%252FWK96071_d3543d0703b3bb78a96adbcf4b61b24e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_d3543d0703b3bb78a96adbcf4b61b24e.jpg not downloaded yet
2026-03-30 11:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_60485a2edb8d93af7386ac5b16c62285.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_a0cf873b9a75a3160ff8e99ae454ef70.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbe%252F28beb34c05d2519182d05ef82db32d9d%252Fpa%252FWK96071_a002e0880b69347a8b5a17860a033fca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_a002e0880b69347a8b5a17860a033fca.jpg not downloaded yet
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbe%252F28beb34c05d2519182d05ef82db32d9d%252Fpa%252FWK96071_979ab492b2dad6fca5ab1826473f7c75.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_979ab492b2dad6fca5ab1826473f7c75.jpg not downloaded yet
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbe%252F28beb34c05d2519182d05ef82db32d9d%252Fpa%252FWK96071_8bd568e45e6d64c20ecb5b0b7084b113.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_8bd568e45e6d64c20ecb5b0b7084b113.jpg not downloaded yet
2026-03-30 11:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_64bd0633136b1620990eb1b5fa4e8c2d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbe%252F28beb34c05d2519182d05ef82db32d9d%252Fpa%252FWK96071_16ccac5faffc25acbf67406846116c8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_16ccac5faffc25acbf67406846116c8b.jpg not downloaded yet
2026-03-30 11:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_d3543d0703b3bb78a96adbcf4b61b24e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738714890>
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e3b9ad-3b69-5780-9150-818d76bf6600/80e3b9ad-3b69-5780-9150-818d76bf6600_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbe%252F28beb34c05d2519182d05ef82db32d9d%252Fpa%252FWK96071_60485a2edb8d93af7386ac5b16c62285.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_60485a2edb8d93af7386ac5b16c62285.jpg saved to cache
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80e3b9ad-3b69-5780-9150-818d76bf6600
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384bbd10>
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e3b9ad-3b69-5780-9150-818d76bf6600/80e3b9ad-3b69-5780-9150-818d76bf6600_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbe%252F28beb34c05d2519182d05ef82db32d9d%252Fpa%252FWK96071_a0cf873b9a75a3160ff8e99ae454ef70.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_a0cf873b9a75a3160ff8e99ae454ef70.jpg saved to cache
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80e3b9ad-3b69-5780-9150-818d76bf6600
2026-03-30 11:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_a002e0880b69347a8b5a17860a033fca.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_2105efd7c1a3bc546d7b7a23e864c827.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_979ab492b2dad6fca5ab1826473f7c75.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_8bd568e45e6d64c20ecb5b0b7084b113.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_16ccac5faffc25acbf67406846116c8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073839fc50>
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e3b9ad-3b69-5780-9150-818d76bf6600/80e3b9ad-3b69-5780-9150-818d76bf6600_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbe%252F28beb34c05d2519182d05ef82db32d9d%252Fpa%252FWK96071_64bd0633136b1620990eb1b5fa4e8c2d.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_64bd0633136b1620990eb1b5fa4e8c2d.jpg saved to cache
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80e3b9ad-3b69-5780-9150-818d76bf6600
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384a0610>
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e3b9ad-3b69-5780-9150-818d76bf6600/80e3b9ad-3b69-5780-9150-818d76bf6600_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbe%252F28beb34c05d2519182d05ef82db32d9d%252Fpa%252FWK96071_d3543d0703b3bb78a96adbcf4b61b24e.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_d3543d0703b3bb78a96adbcf4b61b24e.jpg saved to cache
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80e3b9ad-3b69-5780-9150-818d76bf6600
2026-03-30 11:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_724c4c6a1e86b8842d747af15d8c7dc4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384b9590>
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e3b9ad-3b69-5780-9150-818d76bf6600/80e3b9ad-3b69-5780-9150-818d76bf6600_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbe%252F28beb34c05d2519182d05ef82db32d9d%252Fpa%252FWK96071_a002e0880b69347a8b5a17860a033fca.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_a002e0880b69347a8b5a17860a033fca.jpg saved to cache
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80e3b9ad-3b69-5780-9150-818d76bf6600
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385ec510>
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e3b9ad-3b69-5780-9150-818d76bf6600/80e3b9ad-3b69-5780-9150-818d76bf6600_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbe%252F28beb34c05d2519182d05ef82db32d9d%252Fpa%252FWK96071_2105efd7c1a3bc546d7b7a23e864c827.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_2105efd7c1a3bc546d7b7a23e864c827.jpg saved to cache
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80e3b9ad-3b69-5780-9150-818d76bf6600
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073867f310>
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e3b9ad-3b69-5780-9150-818d76bf6600/80e3b9ad-3b69-5780-9150-818d76bf6600_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbe%252F28beb34c05d2519182d05ef82db32d9d%252Fpa%252FWK96071_979ab492b2dad6fca5ab1826473f7c75.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_979ab492b2dad6fca5ab1826473f7c75.jpg saved to cache
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80e3b9ad-3b69-5780-9150-818d76bf6600
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383ade90>
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e3b9ad-3b69-5780-9150-818d76bf6600/80e3b9ad-3b69-5780-9150-818d76bf6600_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbe%252F28beb34c05d2519182d05ef82db32d9d%252Fpa%252FWK96071_8bd568e45e6d64c20ecb5b0b7084b113.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_8bd568e45e6d64c20ecb5b0b7084b113.jpg saved to cache
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80e3b9ad-3b69-5780-9150-818d76bf6600
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383d37d0>
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e3b9ad-3b69-5780-9150-818d76bf6600/80e3b9ad-3b69-5780-9150-818d76bf6600_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbe%252F28beb34c05d2519182d05ef82db32d9d%252Fpa%252FWK96071_16ccac5faffc25acbf67406846116c8b.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_16ccac5faffc25acbf67406846116c8b.jpg saved to cache
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80e3b9ad-3b69-5780-9150-818d76bf6600
2026-03-30 11:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL85627> (referer: https://www.auto1.com/v1/car-details-view/HL85627/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383c6e90>
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e3b9ad-3b69-5780-9150-818d76bf6600/80e3b9ad-3b69-5780-9150-818d76bf6600_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fbe%252F28beb34c05d2519182d05ef82db32d9d%252Fpa%252FWK96071_724c4c6a1e86b8842d747af15d8c7dc4.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_724c4c6a1e86b8842d747af15d8c7dc4.jpg saved to cache
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80e3b9ad-3b69-5780-9150-818d76bf6600
2026-03-30 11:09:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80e3b9ad-3b69-5780-9150-818d76bf6600, skipping ID generation
2026-03-30 11:09:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80e3b9ad-3b69-5780-9150-818d76bf6600 with scrape type 1
2026-03-30 11:09:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80e3b9ad-3b69-5780-9150-818d76bf6600 sending to next pipeline
2026-03-30 11:09:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 80e3b9ad-3b69-5780-9150-818d76bf6600, identifier: WK96071
2026-03-30 11:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 80e3b9ad-3b69-5780-9150-818d76bf6600 with identifier: WK96071
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:09:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:09:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 80e3b9ad-3b69-5780-9150-818d76bf6600 with identifier: WK96071
2026-03-30 11:09:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 80e3b9ad-3b69-5780-9150-818d76bf6600 with identifier: WK96071 to the API
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_724c4c6a1e86b8842d747af15d8c7dc4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:08:31Z',
'fuel_type': 'diesel',
'id': '80e3b9ad-3b69-5780-9150-818d76bf6600',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK96071',
'listing': 'auction',
'location': 'FR',
'make': 'Nissan',
'model': 'X-Trail',
'odometer': 184860,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e3b9ad-3b69-5780-9150-818d76bf6600/80e3b9ad-3b69-5780-9150-818d76bf6600_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_a0cf873b9a75a3160ff8e99ae454ef70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e3b9ad-3b69-5780-9150-818d76bf6600/80e3b9ad-3b69-5780-9150-818d76bf6600_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49013,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_60485a2edb8d93af7386ac5b16c62285.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e3b9ad-3b69-5780-9150-818d76bf6600/80e3b9ad-3b69-5780-9150-818d76bf6600_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55038,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_2105efd7c1a3bc546d7b7a23e864c827.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e3b9ad-3b69-5780-9150-818d76bf6600/80e3b9ad-3b69-5780-9150-818d76bf6600_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_64bd0633136b1620990eb1b5fa4e8c2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e3b9ad-3b69-5780-9150-818d76bf6600/80e3b9ad-3b69-5780-9150-818d76bf6600_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55820,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_724c4c6a1e86b8842d747af15d8c7dc4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e3b9ad-3b69-5780-9150-818d76bf6600/80e3b9ad-3b69-5780-9150-818d76bf6600_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_d3543d0703b3bb78a96adbcf4b61b24e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e3b9ad-3b69-5780-9150-818d76bf6600/80e3b9ad-3b69-5780-9150-818d76bf6600_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54546,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_a002e0880b69347a8b5a17860a033fca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e3b9ad-3b69-5780-9150-818d76bf6600/80e3b9ad-3b69-5780-9150-818d76bf6600_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 129262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_979ab492b2dad6fca5ab1826473f7c75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e3b9ad-3b69-5780-9150-818d76bf6600/80e3b9ad-3b69-5780-9150-818d76bf6600_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86707,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_8bd568e45e6d64c20ecb5b0b7084b113.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e3b9ad-3b69-5780-9150-818d76bf6600/80e3b9ad-3b69-5780-9150-818d76bf6600_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/be/28beb34c05d2519182d05ef82db32d9d/pa/WK96071_16ccac5faffc25acbf67406846116c8b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-04-03',
'seats_number': 7,
'seller_name': None,
'title': 'Nissan X-Trail 1.6 dCi 360',
'transmission': 'manual',
'trim': '360',
'year': 2016}
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WK96071%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [auto1.fr] INFO: Saving data for WK96071: {'created_time': 1774868962.504796, 'last_price_update_time': 1774868962.504807, 'auction_closing_time': 1774969711.0}
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WK96071') HTTP/1.1" 204 0
2026-03-30 11:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AM96995> (referer: https://www.auto1.com/v1/car-details-view/AM96995/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7 with identifier: HL85627
2026-03-30 11:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7 with scrape type 1
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F1d%252Fdf1d27708878b0d9f1b070912e40696a%252Fpa%252FHL85627_f56f3caf709cd6edce81774599d7fa3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_f56f3caf709cd6edce81774599d7fa3f.jpg already downloaded
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F1d%252Fdf1d27708878b0d9f1b070912e40696a%252Fpa%252FHL85627_4bede599afee6a8457fddc44d960b946.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_4bede599afee6a8457fddc44d960b946.jpg already downloaded
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F1d%252Fdf1d27708878b0d9f1b070912e40696a%252Fpa%252FHL85627_1265bad5f959547e19f1b377cc21df63.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_1265bad5f959547e19f1b377cc21df63.jpg already downloaded
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F1d%252Fdf1d27708878b0d9f1b070912e40696a%252Fpa%252FHL85627_5d81cc7ebdefd438c46933e377b872e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_5d81cc7ebdefd438c46933e377b872e9.jpg already downloaded
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F1d%252Fdf1d27708878b0d9f1b070912e40696a%252Fpa%252FHL85627_32c737a7841d8e6ef79c4f86ac386047.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_32c737a7841d8e6ef79c4f86ac386047.jpg already downloaded
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F1d%252Fdf1d27708878b0d9f1b070912e40696a%252Fpa%252FHL85627_74f5a069726991c98f349520bd91f402.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_74f5a069726991c98f349520bd91f402.jpg already downloaded
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F1d%252Fdf1d27708878b0d9f1b070912e40696a%252Fpa%252FHL85627_152de1f084b4a510eb298726ceef4a35.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_152de1f084b4a510eb298726ceef4a35.jpg already downloaded
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F1d%252Fdf1d27708878b0d9f1b070912e40696a%252Fpa%252FHL85627_92e2d15a1746e76479e3ce19c9b9eff5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_92e2d15a1746e76479e3ce19c9b9eff5.jpg already downloaded
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F1d%252Fdf1d27708878b0d9f1b070912e40696a%252Fpa%252FHL85627_0d9489e0092011dcd7a1a62832ce92f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_0d9489e0092011dcd7a1a62832ce92f4.jpg already downloaded
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F1d%252Fdf1d27708878b0d9f1b070912e40696a%252Fpa%252FHL85627_c43f27ff2ed23f1e5c2518aead288803.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_c43f27ff2ed23f1e5c2518aead288803.jpg already downloaded
2026-03-30 11:09:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7, identifier: HL85627
2026-03-30 11:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY12321> (referer: https://www.auto1.com/v1/car-details-view/YY12321/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7 with identifier: HL85627
2026-03-30 11:09:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7 with identifier: HL85627
2026-03-30 11:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7 with identifier: HL85627 to the API
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HL85627>
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:00:45Z',
'fuel_type': 'petrol',
'id': '80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL85627',
'listing': 'auction',
'location': 'FR, Nanteuil-le-Haudouin',
'make': 'Citroen',
'model': 'C3',
'odometer': 113790,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_f56f3caf709cd6edce81774599d7fa3f.jpg',
'https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_4bede599afee6a8457fddc44d960b946.jpg',
'https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_1265bad5f959547e19f1b377cc21df63.jpg',
'https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_5d81cc7ebdefd438c46933e377b872e9.jpg',
'https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_32c737a7841d8e6ef79c4f86ac386047.jpg',
'https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_74f5a069726991c98f349520bd91f402.jpg',
'https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_152de1f084b4a510eb298726ceef4a35.jpg',
'https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_92e2d15a1746e76479e3ce19c9b9eff5.jpg',
'https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_0d9489e0092011dcd7a1a62832ce92f4.jpg',
'https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_c43f27ff2ed23f1e5c2518aead288803.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7/80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71422,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_f56f3caf709cd6edce81774599d7fa3f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7/80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_4bede599afee6a8457fddc44d960b946.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7/80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_1265bad5f959547e19f1b377cc21df63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7/80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49284,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_5d81cc7ebdefd438c46933e377b872e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7/80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_32c737a7841d8e6ef79c4f86ac386047.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7/80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71740,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_74f5a069726991c98f349520bd91f402.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7/80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57511,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_152de1f084b4a510eb298726ceef4a35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7/80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76468,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_92e2d15a1746e76479e3ce19c9b9eff5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7/80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_0d9489e0092011dcd7a1a62832ce92f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7/80a551cf-73ae-5cd8-b4f3-ab0d7924f5f7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63031,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/1d/df1d27708878b0d9f1b070912e40696a/pa/HL85627_c43f27ff2ed23f1e5c2518aead288803.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-09',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2018}
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL85627%27 HTTP/1.1" 200 None
2026-03-30 11:09:23 [auto1.fr] INFO: Saving data for HL85627: {'created_time': 1774868963.277101, 'last_price_update_time': 1774868963.277112, 'auction_closing_time': 1774969245.0}
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HL85627') HTTP/1.1" 204 0
2026-03-30 11:09:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9 with identifier: AM96995
2026-03-30 11:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9 with scrape type 1
2026-03-30 11:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F98%252Fe798df5d3341771584ada2e7c810db6b%252Fpa%252FAM96995_ea86b5c10a9a28921a445ec787bbc255.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_ea86b5c10a9a28921a445ec787bbc255.jpg already downloaded
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F98%252Fe798df5d3341771584ada2e7c810db6b%252Fpa%252FAM96995_ed6180c9370218ff999ffb7b692aa528.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_ed6180c9370218ff999ffb7b692aa528.jpg already downloaded
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F98%252Fe798df5d3341771584ada2e7c810db6b%252Fpa%252FAM96995_9d9e95c1241b851f07918ed01b568ad2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_9d9e95c1241b851f07918ed01b568ad2.jpg already downloaded
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F98%252Fe798df5d3341771584ada2e7c810db6b%252Fpa%252FAM96995_d375f7e36e73fbe49e8d246615e271ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_d375f7e36e73fbe49e8d246615e271ad.jpg already downloaded
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F98%252Fe798df5d3341771584ada2e7c810db6b%252Fpa%252FAM96995_6d2716c3fea3ad74f964324206c2bcdd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_6d2716c3fea3ad74f964324206c2bcdd.jpg already downloaded
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F98%252Fe798df5d3341771584ada2e7c810db6b%252Fpa%252FAM96995_3b266094ed08d6c31da184a4ecd38c50.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_3b266094ed08d6c31da184a4ecd38c50.jpg already downloaded
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F98%252Fe798df5d3341771584ada2e7c810db6b%252Fpa%252FAM96995_dca31b7dd480d6b04027bcf6b97b2b10.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_dca31b7dd480d6b04027bcf6b97b2b10.jpg already downloaded
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F98%252Fe798df5d3341771584ada2e7c810db6b%252Fpa%252FAM96995_d0d6b30fcb7027b7bd6a6ce804267ed2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_d0d6b30fcb7027b7bd6a6ce804267ed2.jpg already downloaded
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F98%252Fe798df5d3341771584ada2e7c810db6b%252Fpa%252FAM96995_a8f3c3f2683aae5845992f2298a39ab7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_a8f3c3f2683aae5845992f2298a39ab7.jpg already downloaded
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F98%252Fe798df5d3341771584ada2e7c810db6b%252Fpa%252FAM96995_a5339f48acf51717b38150347d51f16a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_a5339f48acf51717b38150347d51f16a.jpg already downloaded
2026-03-30 11:09:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9, identifier: AM96995
2026-03-30 11:09:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f87c8744-90fd-5b60-94cf-4f26a8fa9821 with identifier: YY12321
2026-03-30 11:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f87c8744-90fd-5b60-94cf-4f26a8fa9821 with scrape type 1
2026-03-30 11:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f87c8744-90fd-5b60-94cf-4f26a8fa9821
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F95%252F119546b88e44d0ba772eae80f4c0f77e%252Fpa%252FYY12321_503e62beb99219d14d35059145d7f006.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_503e62beb99219d14d35059145d7f006.jpg not downloaded yet
2026-03-30 11:09:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9 with identifier: AM96995
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 11:09:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:09:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9 with identifier: AM96995
2026-03-30 11:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9 with identifier: AM96995 to the API
2026-03-30 11:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AM96995>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:26:54Z',
'fuel_type': 'petrol',
'id': '3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM96995',
'listing': 'auction',
'location': 'FR, Marckolsheim',
'make': 'Peugeot',
'model': '108',
'odometer': 83066,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_ea86b5c10a9a28921a445ec787bbc255.jpg',
'https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_ed6180c9370218ff999ffb7b692aa528.jpg',
'https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_9d9e95c1241b851f07918ed01b568ad2.jpg',
'https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_d375f7e36e73fbe49e8d246615e271ad.jpg',
'https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_6d2716c3fea3ad74f964324206c2bcdd.jpg',
'https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_3b266094ed08d6c31da184a4ecd38c50.jpg',
'https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_dca31b7dd480d6b04027bcf6b97b2b10.jpg',
'https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_d0d6b30fcb7027b7bd6a6ce804267ed2.jpg',
'https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_a8f3c3f2683aae5845992f2298a39ab7.jpg',
'https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_a5339f48acf51717b38150347d51f16a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9/3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76632,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_ea86b5c10a9a28921a445ec787bbc255.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9/3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2722687,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_ed6180c9370218ff999ffb7b692aa528.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9/3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78355,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_9d9e95c1241b851f07918ed01b568ad2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9/3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2885691,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_d375f7e36e73fbe49e8d246615e271ad.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9/3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58162,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_6d2716c3fea3ad74f964324206c2bcdd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9/3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_3b266094ed08d6c31da184a4ecd38c50.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9/3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55698,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_dca31b7dd480d6b04027bcf6b97b2b10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9/3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68786,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_d0d6b30fcb7027b7bd6a6ce804267ed2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9/3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2618374,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_a8f3c3f2683aae5845992f2298a39ab7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9/3ddfcd92-cca4-53cd-a232-2fc3bf8d22a9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2753237,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/98/e798df5d3341771584ada2e7c810db6b/pa/AM96995_a5339f48acf51717b38150347d51f16a.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-02-02',
'seats_number': 4,
'seller_name': None,
'title': 'Peugeot 108 1.2 VTi Envy',
'transmission': 'manual',
'trim': 'Envy',
'year': 2016}
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM96995%27 HTTP/1.1" 200 None
2026-03-30 11:09:24 [auto1.fr] INFO: Saving data for AM96995: {'created_time': 1774868964.265246, 'last_price_update_time': 1774868964.265261, 'auction_closing_time': 1774970814.0}
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AM96995') HTTP/1.1" 204 0
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F95%252F119546b88e44d0ba772eae80f4c0f77e%252Fpa%252FYY12321_55045992a2b18b6dc248eec25903ce33.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_55045992a2b18b6dc248eec25903ce33.jpg not downloaded yet
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F95%252F119546b88e44d0ba772eae80f4c0f77e%252Fpa%252FYY12321_c12986c1fbdef7c1648316291eb9a261.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_c12986c1fbdef7c1648316291eb9a261.jpg not downloaded yet
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F95%252F119546b88e44d0ba772eae80f4c0f77e%252Fpa%252FYY12321_b94e9bd0471b059f15c4f8347dfe0cf2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_b94e9bd0471b059f15c4f8347dfe0cf2.jpg not downloaded yet
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F95%252F119546b88e44d0ba772eae80f4c0f77e%252Fpa%252FYY12321_3eb1052b5c486b9d8301f469b9203830.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_3eb1052b5c486b9d8301f469b9203830.jpg not downloaded yet
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F95%252F119546b88e44d0ba772eae80f4c0f77e%252Fpa%252FYY12321_914fcc93979a2c278eb9fbb7e5d9fb65.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_914fcc93979a2c278eb9fbb7e5d9fb65.jpg not downloaded yet
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F95%252F119546b88e44d0ba772eae80f4c0f77e%252Fpa%252FYY12321_704196bcdff673fc880371e4dfa50d77.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_704196bcdff673fc880371e4dfa50d77.jpg not downloaded yet
2026-03-30 11:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_503e62beb99219d14d35059145d7f006.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_55045992a2b18b6dc248eec25903ce33.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F95%252F119546b88e44d0ba772eae80f4c0f77e%252Fpa%252FYY12321_3dfbf2742a2fdbfac48bd039fb7b1924.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_3dfbf2742a2fdbfac48bd039fb7b1924.jpg not downloaded yet
2026-03-30 11:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_c12986c1fbdef7c1648316291eb9a261.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F95%252F119546b88e44d0ba772eae80f4c0f77e%252Fpa%252FYY12321_4564294ae7567068e1f30348c152a92d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_4564294ae7567068e1f30348c152a92d.jpg not downloaded yet
2026-03-30 11:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_b94e9bd0471b059f15c4f8347dfe0cf2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F95%252F119546b88e44d0ba772eae80f4c0f77e%252Fpa%252FYY12321_faf42c3a124b05ea64c2ae956132eb6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_faf42c3a124b05ea64c2ae956132eb6d.jpg not downloaded yet
2026-03-30 11:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_3eb1052b5c486b9d8301f469b9203830.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_faf42c3a124b05ea64c2ae956132eb6d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_4564294ae7567068e1f30348c152a92d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385dcbd0>
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f87c8744-90fd-5b60-94cf-4f26a8fa9821/f87c8744-90fd-5b60-94cf-4f26a8fa9821_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F95%252F119546b88e44d0ba772eae80f4c0f77e%252Fpa%252FYY12321_503e62beb99219d14d35059145d7f006.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_503e62beb99219d14d35059145d7f006.jpg saved to cache
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f87c8744-90fd-5b60-94cf-4f26a8fa9821
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738557490>
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f87c8744-90fd-5b60-94cf-4f26a8fa9821/f87c8744-90fd-5b60-94cf-4f26a8fa9821_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F95%252F119546b88e44d0ba772eae80f4c0f77e%252Fpa%252FYY12321_55045992a2b18b6dc248eec25903ce33.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_55045992a2b18b6dc248eec25903ce33.jpg saved to cache
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f87c8744-90fd-5b60-94cf-4f26a8fa9821
2026-03-30 11:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_3dfbf2742a2fdbfac48bd039fb7b1924.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073875f150>
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f87c8744-90fd-5b60-94cf-4f26a8fa9821/f87c8744-90fd-5b60-94cf-4f26a8fa9821_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F95%252F119546b88e44d0ba772eae80f4c0f77e%252Fpa%252FYY12321_c12986c1fbdef7c1648316291eb9a261.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_c12986c1fbdef7c1648316291eb9a261.jpg saved to cache
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f87c8744-90fd-5b60-94cf-4f26a8fa9821
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738706050>
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f87c8744-90fd-5b60-94cf-4f26a8fa9821/f87c8744-90fd-5b60-94cf-4f26a8fa9821_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F95%252F119546b88e44d0ba772eae80f4c0f77e%252Fpa%252FYY12321_b94e9bd0471b059f15c4f8347dfe0cf2.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_b94e9bd0471b059f15c4f8347dfe0cf2.jpg saved to cache
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f87c8744-90fd-5b60-94cf-4f26a8fa9821
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738563110>
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f87c8744-90fd-5b60-94cf-4f26a8fa9821/f87c8744-90fd-5b60-94cf-4f26a8fa9821_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F95%252F119546b88e44d0ba772eae80f4c0f77e%252Fpa%252FYY12321_3eb1052b5c486b9d8301f469b9203830.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_3eb1052b5c486b9d8301f469b9203830.jpg saved to cache
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f87c8744-90fd-5b60-94cf-4f26a8fa9821
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738721890>
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f87c8744-90fd-5b60-94cf-4f26a8fa9821/f87c8744-90fd-5b60-94cf-4f26a8fa9821_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F95%252F119546b88e44d0ba772eae80f4c0f77e%252Fpa%252FYY12321_faf42c3a124b05ea64c2ae956132eb6d.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_faf42c3a124b05ea64c2ae956132eb6d.jpg saved to cache
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f87c8744-90fd-5b60-94cf-4f26a8fa9821
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073859c510>
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f87c8744-90fd-5b60-94cf-4f26a8fa9821/f87c8744-90fd-5b60-94cf-4f26a8fa9821_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F95%252F119546b88e44d0ba772eae80f4c0f77e%252Fpa%252FYY12321_4564294ae7567068e1f30348c152a92d.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_4564294ae7567068e1f30348c152a92d.jpg saved to cache
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f87c8744-90fd-5b60-94cf-4f26a8fa9821
2026-03-30 11:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_914fcc93979a2c278eb9fbb7e5d9fb65.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_704196bcdff673fc880371e4dfa50d77.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a8b63d0>
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f87c8744-90fd-5b60-94cf-4f26a8fa9821/f87c8744-90fd-5b60-94cf-4f26a8fa9821_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F95%252F119546b88e44d0ba772eae80f4c0f77e%252Fpa%252FYY12321_3dfbf2742a2fdbfac48bd039fb7b1924.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_3dfbf2742a2fdbfac48bd039fb7b1924.jpg saved to cache
2026-03-30 11:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f87c8744-90fd-5b60-94cf-4f26a8fa9821
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738716ed0>
2026-03-30 11:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f87c8744-90fd-5b60-94cf-4f26a8fa9821/f87c8744-90fd-5b60-94cf-4f26a8fa9821_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F95%252F119546b88e44d0ba772eae80f4c0f77e%252Fpa%252FYY12321_914fcc93979a2c278eb9fbb7e5d9fb65.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_914fcc93979a2c278eb9fbb7e5d9fb65.jpg saved to cache
2026-03-30 11:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f87c8744-90fd-5b60-94cf-4f26a8fa9821
2026-03-30 11:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385d5810>
2026-03-30 11:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f87c8744-90fd-5b60-94cf-4f26a8fa9821/f87c8744-90fd-5b60-94cf-4f26a8fa9821_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F95%252F119546b88e44d0ba772eae80f4c0f77e%252Fpa%252FYY12321_704196bcdff673fc880371e4dfa50d77.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_704196bcdff673fc880371e4dfa50d77.jpg saved to cache
2026-03-30 11:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f87c8744-90fd-5b60-94cf-4f26a8fa9821
2026-03-30 11:09:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f87c8744-90fd-5b60-94cf-4f26a8fa9821, skipping ID generation
2026-03-30 11:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f87c8744-90fd-5b60-94cf-4f26a8fa9821 with scrape type 1
2026-03-30 11:09:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f87c8744-90fd-5b60-94cf-4f26a8fa9821 sending to next pipeline
2026-03-30 11:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f87c8744-90fd-5b60-94cf-4f26a8fa9821, identifier: YY12321
2026-03-30 11:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f87c8744-90fd-5b60-94cf-4f26a8fa9821 with identifier: YY12321
2026-03-30 11:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f87c8744-90fd-5b60-94cf-4f26a8fa9821 with identifier: YY12321
2026-03-30 11:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f87c8744-90fd-5b60-94cf-4f26a8fa9821 with identifier: YY12321 to the API
2026-03-30 11:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_704196bcdff673fc880371e4dfa50d77.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:01:54Z',
'fuel_type': 'diesel',
'id': 'f87c8744-90fd-5b60-94cf-4f26a8fa9821',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY12321',
'listing': 'auction',
'location': 'FR, LA CHAPELLE LONGUEVILLE',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 218626,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f87c8744-90fd-5b60-94cf-4f26a8fa9821/f87c8744-90fd-5b60-94cf-4f26a8fa9821_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_503e62beb99219d14d35059145d7f006.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f87c8744-90fd-5b60-94cf-4f26a8fa9821/f87c8744-90fd-5b60-94cf-4f26a8fa9821_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103055,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_55045992a2b18b6dc248eec25903ce33.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f87c8744-90fd-5b60-94cf-4f26a8fa9821/f87c8744-90fd-5b60-94cf-4f26a8fa9821_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88665,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_c12986c1fbdef7c1648316291eb9a261.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f87c8744-90fd-5b60-94cf-4f26a8fa9821/f87c8744-90fd-5b60-94cf-4f26a8fa9821_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_b94e9bd0471b059f15c4f8347dfe0cf2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f87c8744-90fd-5b60-94cf-4f26a8fa9821/f87c8744-90fd-5b60-94cf-4f26a8fa9821_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95112,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_3eb1052b5c486b9d8301f469b9203830.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f87c8744-90fd-5b60-94cf-4f26a8fa9821/f87c8744-90fd-5b60-94cf-4f26a8fa9821_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89561,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_914fcc93979a2c278eb9fbb7e5d9fb65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f87c8744-90fd-5b60-94cf-4f26a8fa9821/f87c8744-90fd-5b60-94cf-4f26a8fa9821_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76420,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_704196bcdff673fc880371e4dfa50d77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f87c8744-90fd-5b60-94cf-4f26a8fa9821/f87c8744-90fd-5b60-94cf-4f26a8fa9821_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98402,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_3dfbf2742a2fdbfac48bd039fb7b1924.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f87c8744-90fd-5b60-94cf-4f26a8fa9821/f87c8744-90fd-5b60-94cf-4f26a8fa9821_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_4564294ae7567068e1f30348c152a92d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f87c8744-90fd-5b60-94cf-4f26a8fa9821/f87c8744-90fd-5b60-94cf-4f26a8fa9821_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72022,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/95/119546b88e44d0ba772eae80f4c0f77e/pa/YY12321_faf42c3a124b05ea64c2ae956132eb6d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 d',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-30 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY12321%27 HTTP/1.1" 200 None
2026-03-30 11:09:25 [auto1.fr] INFO: Saving data for YY12321: {'created_time': 1774868965.537423, 'last_price_update_time': 1774868965.537432, 'auction_closing_time': 1774969314.0}
2026-03-30 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YY12321') HTTP/1.1" 204 0
2026-03-30 11:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:30 [auto1.fr] INFO: Channel: 24h | Page: 2 | totalHits: 5534 | hits on page: 40
2026-03-30 11:09:30 [auto1.fr] INFO: Found listing with ID: PR46481
2026-03-30 11:09:30 [auto1.fr] INFO: Found listing with ID: WK96071
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WK96071%27 HTTP/1.1" 200 None
2026-03-30 11:09:30 [auto1.fr] INFO: Scrape type for WK96071: 0
2026-03-30 11:09:30 [auto1.fr] INFO: Found listing with ID: CN71105
2026-03-30 11:09:30 [auto1.fr] INFO: Found listing with ID: EF37210
2026-03-30 11:09:30 [auto1.fr] INFO: Found listing with ID: BR75524
2026-03-30 11:09:30 [auto1.fr] INFO: Found listing with ID: BH81493
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH81493%27 HTTP/1.1" 200 None
2026-03-30 11:09:30 [auto1.fr] INFO: Scrape type for BH81493: 1
2026-03-30 11:09:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:30 [auto1.fr] INFO: Found listing with ID: AC83389
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC83389%27 HTTP/1.1" 200 None
2026-03-30 11:09:30 [auto1.fr] INFO: Scrape type for AC83389: 2
2026-03-30 11:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a2cb6e1-6a02-5a0b-872b-d4a1ea8103ae with identifier: AC83389
2026-03-30 11:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a2cb6e1-6a02-5a0b-872b-d4a1ea8103ae with scrape type 2
2026-03-30 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a2cb6e1-6a02-5a0b-872b-d4a1ea8103ae with scrape type 2
2026-03-30 11:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5a2cb6e1-6a02-5a0b-872b-d4a1ea8103ae, identifier: AC83389
2026-03-30 11:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5a2cb6e1-6a02-5a0b-872b-d4a1ea8103ae with identifier: AC83389
2026-03-30 11:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5a2cb6e1-6a02-5a0b-872b-d4a1ea8103ae with identifier: AC83389
2026-03-30 11:09:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5a2cb6e1-6a02-5a0b-872b-d4a1ea8103ae with identifier: AC83389 to the API
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:03:01Z',
'fuel_type': 'petrol',
'id': '5a2cb6e1-6a02-5a0b-872b-d4a1ea8103ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC83389',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 79868,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-01',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2022}
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC83389%27 HTTP/1.1" 200 None
2026-03-30 11:09:31 [auto1.fr] INFO: Saving data for AC83389: {'auction_closing_time': 1774969381.0, 'created_time': 1773693287.717522, 'last_price_update_time': 1774868971.976569}
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AC83389') HTTP/1.1" 204 0
2026-03-30 11:09:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:31 [auto1.fr] INFO: Found listing with ID: RP10604
2026-03-30 11:09:31 [auto1.fr] INFO: Found listing with ID: SY05693
2026-03-30 11:09:31 [auto1.fr] INFO: Found listing with ID: LD59929
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LD59929%27 HTTP/1.1" 200 None
2026-03-30 11:09:32 [auto1.fr] INFO: Scrape type for LD59929: 2
2026-03-30 11:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c5588de-f576-5fad-af38-d691548d7b47 with identifier: LD59929
2026-03-30 11:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c5588de-f576-5fad-af38-d691548d7b47 with scrape type 2
2026-03-30 11:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c5588de-f576-5fad-af38-d691548d7b47 with scrape type 2
2026-03-30 11:09:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8c5588de-f576-5fad-af38-d691548d7b47, identifier: LD59929
2026-03-30 11:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8c5588de-f576-5fad-af38-d691548d7b47 with identifier: LD59929
2026-03-30 11:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8c5588de-f576-5fad-af38-d691548d7b47 with identifier: LD59929
2026-03-30 11:09:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8c5588de-f576-5fad-af38-d691548d7b47 with identifier: LD59929 to the API
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:18:46Z',
'fuel_type': 'diesel',
'id': '8c5588de-f576-5fad-af38-d691548d7b47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD59929',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 190001,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-06',
'seller_name': None,
'title': 'Skoda Octavia 1.6 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2013}
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LD59929%27 HTTP/1.1" 200 None
2026-03-30 11:09:32 [auto1.fr] INFO: Saving data for LD59929: {'auction_closing_time': 1774970326.0, 'created_time': 1772186746.767301, 'last_price_update_time': 1774868972.599771}
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LD59929') HTTP/1.1" 204 0
2026-03-30 11:09:32 [auto1.fr] INFO: Found listing with ID: XY40736
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XY40736%27 HTTP/1.1" 200 None
2026-03-30 11:09:32 [auto1.fr] INFO: Scrape type for XY40736: 2
2026-03-30 11:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c20eab8c-2f24-53a4-b08b-ea2d01761667 with identifier: XY40736
2026-03-30 11:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c20eab8c-2f24-53a4-b08b-ea2d01761667 with scrape type 2
2026-03-30 11:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c20eab8c-2f24-53a4-b08b-ea2d01761667 with scrape type 2
2026-03-30 11:09:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c20eab8c-2f24-53a4-b08b-ea2d01761667, identifier: XY40736
2026-03-30 11:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c20eab8c-2f24-53a4-b08b-ea2d01761667 with identifier: XY40736
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 11:09:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c20eab8c-2f24-53a4-b08b-ea2d01761667 with identifier: XY40736
2026-03-30 11:09:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c20eab8c-2f24-53a4-b08b-ea2d01761667 with identifier: XY40736 to the API
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:41:28Z',
'fuel_type': 'petrol',
'id': 'c20eab8c-2f24-53a4-b08b-ea2d01761667',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY40736',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 113615,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-11-27',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2007}
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XY40736%27 HTTP/1.1" 200 None
2026-03-30 11:09:33 [auto1.fr] INFO: Saving data for XY40736: {'auction_closing_time': 1774971688.0, 'created_time': 1774382753.707929, 'last_price_update_time': 1774868973.475897}
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XY40736') HTTP/1.1" 204 0
2026-03-30 11:09:33 [auto1.fr] INFO: Found listing with ID: WS97350
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS97350%27 HTTP/1.1" 200 None
2026-03-30 11:09:33 [auto1.fr] INFO: Scrape type for WS97350: 1
2026-03-30 11:09:33 [auto1.fr] INFO: Found listing with ID: TL58072
2026-03-30 11:09:33 [auto1.fr] INFO: Found listing with ID: KX79018
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX79018%27 HTTP/1.1" 200 None
2026-03-30 11:09:33 [auto1.fr] INFO: Scrape type for KX79018: 1
2026-03-30 11:09:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:33 [auto1.fr] INFO: Found listing with ID: BH39999
2026-03-30 11:09:33 [auto1.fr] INFO: Found listing with ID: NH49785
2026-03-30 11:09:33 [auto1.fr] INFO: Found listing with ID: CV88444
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV88444%27 HTTP/1.1" 200 None
2026-03-30 11:09:33 [auto1.fr] INFO: Scrape type for CV88444: 2
2026-03-30 11:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab00f863-b574-5c36-bb9f-a1fc9109de56 with identifier: CV88444
2026-03-30 11:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab00f863-b574-5c36-bb9f-a1fc9109de56 with scrape type 2
2026-03-30 11:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab00f863-b574-5c36-bb9f-a1fc9109de56 with scrape type 2
2026-03-30 11:09:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ab00f863-b574-5c36-bb9f-a1fc9109de56, identifier: CV88444
2026-03-30 11:09:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ab00f863-b574-5c36-bb9f-a1fc9109de56 with identifier: CV88444
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 11:09:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ab00f863-b574-5c36-bb9f-a1fc9109de56 with identifier: CV88444
2026-03-30 11:09:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ab00f863-b574-5c36-bb9f-a1fc9109de56 with identifier: CV88444 to the API
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:04:06Z',
'fuel_type': 'petrol',
'id': 'ab00f863-b574-5c36-bb9f-a1fc9109de56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV88444',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 96632,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-17',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Advance Style',
'transmission': 'automatic',
'trim': 'Advance Style',
'year': 2019}
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV88444%27 HTTP/1.1" 200 None
2026-03-30 11:09:34 [auto1.fr] INFO: Saving data for CV88444: {'auction_closing_time': 1774969446.0, 'created_time': 1773050590.579409, 'last_price_update_time': 1774868974.151615}
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CV88444') HTTP/1.1" 204 0
2026-03-30 11:09:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: NY83999
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: MC89388
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: EG50461
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: BU50680
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: PR53320
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: NT01211
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: SJ86891
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: GV14574
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: ZP24027
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: YP42607
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: CR02968
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR02968%27 HTTP/1.1" 200 None
2026-03-30 11:09:34 [auto1.fr] INFO: Scrape type for CR02968: 1
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: SD98356
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: CC91432
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC91432%27 HTTP/1.1" 200 None
2026-03-30 11:09:34 [auto1.fr] INFO: Scrape type for CC91432: 1
2026-03-30 11:09:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: MF38303
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: WZ42856
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ42856%27 HTTP/1.1" 200 None
2026-03-30 11:09:34 [auto1.fr] INFO: Scrape type for WZ42856: 1
2026-03-30 11:09:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: ED93860
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED93860%27 HTTP/1.1" 200 None
2026-03-30 11:09:34 [auto1.fr] INFO: Scrape type for ED93860: 1
2026-03-30 11:09:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: RW88857
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: UY14685
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY14685%27 HTTP/1.1" 200 None
2026-03-30 11:09:34 [auto1.fr] INFO: Scrape type for UY14685: 1
2026-03-30 11:09:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: UN11275
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN11275%27 HTTP/1.1" 200 None
2026-03-30 11:09:34 [auto1.fr] INFO: Scrape type for UN11275: 1
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: LZ68007
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: PY98810
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY98810%27 HTTP/1.1" 200 None
2026-03-30 11:09:34 [auto1.fr] INFO: Scrape type for PY98810: 1
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: GM21063
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: UM27725
2026-03-30 11:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:35 [auto1.fr] INFO: Channel: 24h | Page: 3 | totalHits: 5534 | hits on page: 40
2026-03-30 11:09:35 [auto1.fr] INFO: Found listing with ID: SZ69319
2026-03-30 11:09:35 [auto1.fr] INFO: Found listing with ID: PZ99671
2026-03-30 11:09:35 [auto1.fr] INFO: Found listing with ID: NS29326
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS29326%27 HTTP/1.1" 200 None
2026-03-30 11:09:35 [auto1.fr] INFO: Scrape type for NS29326: 1
2026-03-30 11:09:35 [auto1.fr] INFO: Found listing with ID: KY08586
2026-03-30 11:09:35 [auto1.fr] INFO: Found listing with ID: CH55510
2026-03-30 11:09:35 [auto1.fr] INFO: Found listing with ID: JG04823
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG04823%27 HTTP/1.1" 200 None
2026-03-30 11:09:35 [auto1.fr] INFO: Scrape type for JG04823: 2
2026-03-30 11:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f8e6fa5-2f1c-5653-82e0-99c127552576 with identifier: JG04823
2026-03-30 11:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f8e6fa5-2f1c-5653-82e0-99c127552576 with scrape type 2
2026-03-30 11:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f8e6fa5-2f1c-5653-82e0-99c127552576 with scrape type 2
2026-03-30 11:09:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5f8e6fa5-2f1c-5653-82e0-99c127552576, identifier: JG04823
2026-03-30 11:09:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5f8e6fa5-2f1c-5653-82e0-99c127552576 with identifier: JG04823
2026-03-30 11:09:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5f8e6fa5-2f1c-5653-82e0-99c127552576 with identifier: JG04823
2026-03-30 11:09:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5f8e6fa5-2f1c-5653-82e0-99c127552576 with identifier: JG04823 to the API
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:22:19Z',
'fuel_type': 'diesel',
'id': '5f8e6fa5-2f1c-5653-82e0-99c127552576',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG04823',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia',
'odometer': 318779,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-06',
'seller_name': None,
'title': 'Opel Insignia 2.0 CDTI Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2010}
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG04823%27 HTTP/1.1" 200 None
2026-03-30 11:09:35 [auto1.fr] INFO: Saving data for JG04823: {'auction_closing_time': 1774970539.0, 'created_time': 1774296684.721608, 'last_price_update_time': 1774868975.776037}
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JG04823') HTTP/1.1" 204 0
2026-03-30 11:09:35 [auto1.fr] INFO: Found listing with ID: JT52746
2026-03-30 11:09:35 [auto1.fr] INFO: Found listing with ID: RC08561
2026-03-30 11:09:35 [auto1.fr] INFO: Found listing with ID: YS81962
2026-03-30 11:09:35 [auto1.fr] INFO: Found listing with ID: XL73746
2026-03-30 11:09:35 [auto1.fr] INFO: Found listing with ID: SJ22403
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ22403%27 HTTP/1.1" 200 None
2026-03-30 11:09:35 [auto1.fr] INFO: Scrape type for SJ22403: 2
2026-03-30 11:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14822336-3e2d-51c9-a28a-2d9c39920477 with identifier: SJ22403
2026-03-30 11:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14822336-3e2d-51c9-a28a-2d9c39920477 with scrape type 2
2026-03-30 11:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14822336-3e2d-51c9-a28a-2d9c39920477 with scrape type 2
2026-03-30 11:09:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 14822336-3e2d-51c9-a28a-2d9c39920477, identifier: SJ22403
2026-03-30 11:09:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 14822336-3e2d-51c9-a28a-2d9c39920477 with identifier: SJ22403
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-30 11:09:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:09:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 14822336-3e2d-51c9-a28a-2d9c39920477 with identifier: SJ22403
2026-03-30 11:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 14822336-3e2d-51c9-a28a-2d9c39920477 with identifier: SJ22403 to the API
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-31T15:43:48Z',
'fuel_type': 'petrol',
'id': '14822336-3e2d-51c9-a28a-2d9c39920477',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ22403',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 111125,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-10',
'seller_name': None,
'title': 'Hyundai i10 1.2 Intuitive & Style',
'transmission': 'manual',
'trim': 'Intuitive & Style',
'year': 2011}
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ22403%27 HTTP/1.1" 200 None
2026-03-30 11:09:36 [auto1.fr] INFO: Saving data for SJ22403: {'auction_closing_time': 1774971828.0, 'created_time': 1774279082.808629, 'last_price_update_time': 1774868976.413112}
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SJ22403') HTTP/1.1" 204 0
2026-03-30 11:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX79018/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WS97350/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:36 [auto1.fr] INFO: Found listing with ID: NW68535
2026-03-30 11:09:36 [auto1.fr] INFO: Found listing with ID: KA64045
2026-03-30 11:09:36 [auto1.fr] INFO: Found listing with ID: ZD89512
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD89512%27 HTTP/1.1" 200 None
2026-03-30 11:09:36 [auto1.fr] INFO: Scrape type for ZD89512: 1
2026-03-30 11:09:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH81493/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ED93860/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:36 [auto1.fr] INFO: Found listing with ID: AG33226
2026-03-30 11:09:36 [auto1.fr] INFO: Found listing with ID: EV69519
2026-03-30 11:09:36 [auto1.fr] INFO: Found listing with ID: ZC47446
2026-03-30 11:09:36 [auto1.fr] INFO: Found listing with ID: MH84462
2026-03-30 11:09:36 [auto1.fr] INFO: Found listing with ID: FW05670
2026-03-30 11:09:36 [auto1.fr] INFO: Found listing with ID: YV12989
2026-03-30 11:09:36 [auto1.fr] INFO: Found listing with ID: NW87362
2026-03-30 11:09:36 [auto1.fr] INFO: Found listing with ID: UY26535
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY26535%27 HTTP/1.1" 200 None
2026-03-30 11:09:36 [auto1.fr] INFO: Scrape type for UY26535: 2
2026-03-30 11:09:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0078eb75-d789-55f5-b34f-fc9a096ba68e with identifier: UY26535
2026-03-30 11:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0078eb75-d789-55f5-b34f-fc9a096ba68e with scrape type 2
2026-03-30 11:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0078eb75-d789-55f5-b34f-fc9a096ba68e with scrape type 2
2026-03-30 11:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0078eb75-d789-55f5-b34f-fc9a096ba68e, identifier: UY26535
2026-03-30 11:09:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0078eb75-d789-55f5-b34f-fc9a096ba68e with identifier: UY26535
2026-03-30 11:09:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0078eb75-d789-55f5-b34f-fc9a096ba68e with identifier: UY26535
2026-03-30 11:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0078eb75-d789-55f5-b34f-fc9a096ba68e with identifier: UY26535 to the API
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:32:39Z',
'fuel_type': 'diesel',
'id': '0078eb75-d789-55f5-b34f-fc9a096ba68e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY26535',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 263310,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-06',
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2009}
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY26535%27 HTTP/1.1" 200 None
2026-03-30 11:09:36 [auto1.fr] INFO: Saving data for UY26535: {'auction_closing_time': 1774971159.0, 'created_time': 1774537989.646808, 'last_price_update_time': 1774868976.905535}
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UY26535') HTTP/1.1" 204 0
2026-03-30 11:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CR02968/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:37 [auto1.fr] INFO: Found listing with ID: NG50520
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG50520%27 HTTP/1.1" 200 None
2026-03-30 11:09:37 [auto1.fr] INFO: Scrape type for NG50520: 2
2026-03-30 11:09:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d7c7af4-a53d-58d3-b5aa-67f721bac7ab with identifier: NG50520
2026-03-30 11:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d7c7af4-a53d-58d3-b5aa-67f721bac7ab with scrape type 2
2026-03-30 11:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d7c7af4-a53d-58d3-b5aa-67f721bac7ab with scrape type 2
2026-03-30 11:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3d7c7af4-a53d-58d3-b5aa-67f721bac7ab, identifier: NG50520
2026-03-30 11:09:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3d7c7af4-a53d-58d3-b5aa-67f721bac7ab with identifier: NG50520
2026-03-30 11:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3d7c7af4-a53d-58d3-b5aa-67f721bac7ab with identifier: NG50520
2026-03-30 11:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3d7c7af4-a53d-58d3-b5aa-67f721bac7ab with identifier: NG50520 to the API
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:27:12Z',
'fuel_type': 'petrol',
'id': '3d7c7af4-a53d-58d3-b5aa-67f721bac7ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG50520',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 117223,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-13',
'seller_name': None,
'title': 'Citroen C3 1.0 VTi Tonic',
'transmission': 'manual',
'trim': 'Tonic',
'year': 2014}
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG50520%27 HTTP/1.1" 200 None
2026-03-30 11:09:37 [auto1.fr] INFO: Saving data for NG50520: {'auction_closing_time': 1774970832.0, 'created_time': 1774365371.390367, 'last_price_update_time': 1774868977.545041}
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NG50520') HTTP/1.1" 204 0
2026-03-30 11:09:37 [auto1.fr] INFO: Found listing with ID: EJ12515
2026-03-30 11:09:37 [auto1.fr] INFO: Found listing with ID: EB00923
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB00923%27 HTTP/1.1" 200 None
2026-03-30 11:09:37 [auto1.fr] INFO: Scrape type for EB00923: 2
2026-03-30 11:09:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21bd87b8-7b1f-5144-8f48-128d57073dc4 with identifier: EB00923
2026-03-30 11:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21bd87b8-7b1f-5144-8f48-128d57073dc4 with scrape type 2
2026-03-30 11:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21bd87b8-7b1f-5144-8f48-128d57073dc4 with scrape type 2
2026-03-30 11:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 21bd87b8-7b1f-5144-8f48-128d57073dc4, identifier: EB00923
2026-03-30 11:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 21bd87b8-7b1f-5144-8f48-128d57073dc4 with identifier: EB00923
2026-03-30 11:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 21bd87b8-7b1f-5144-8f48-128d57073dc4 with identifier: EB00923
2026-03-30 11:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 21bd87b8-7b1f-5144-8f48-128d57073dc4 with identifier: EB00923 to the API
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:12:05Z',
'fuel_type': 'diesel',
'id': '21bd87b8-7b1f-5144-8f48-128d57073dc4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB00923',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 97482,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-15',
'seller_name': None,
'title': 'Audi Q3 2.0 TDI quattro Ambiente',
'transmission': 'automatic',
'trim': 'quattro Ambiente',
'year': 2017}
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB00923%27 HTTP/1.1" 200 None
2026-03-30 11:09:37 [auto1.fr] INFO: Saving data for EB00923: {'auction_closing_time': 1774969925.0, 'created_time': 1774264544.664493, 'last_price_update_time': 1774868977.99026}
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EB00923') HTTP/1.1" 204 0
2026-03-30 11:09:38 [auto1.fr] INFO: Found listing with ID: AM99663
2026-03-30 11:09:38 [auto1.fr] INFO: Found listing with ID: RV60833
2026-03-30 11:09:38 [auto1.fr] INFO: Found listing with ID: AK05387
2026-03-30 11:09:38 [auto1.fr] INFO: Found listing with ID: ER68789
2026-03-30 11:09:38 [auto1.fr] INFO: Found listing with ID: VE80756
2026-03-30 11:09:38 [auto1.fr] INFO: Found listing with ID: GL02133
2026-03-30 11:09:38 [auto1.fr] INFO: Found listing with ID: VX49143
2026-03-30 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX49143%27 HTTP/1.1" 200 None
2026-03-30 11:09:38 [auto1.fr] INFO: Scrape type for VX49143: 2
2026-03-30 11:09:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7887ba27-3cab-5de4-ac81-f56c622e95c2 with identifier: VX49143
2026-03-30 11:09:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7887ba27-3cab-5de4-ac81-f56c622e95c2 with scrape type 2
2026-03-30 11:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7887ba27-3cab-5de4-ac81-f56c622e95c2 with scrape type 2
2026-03-30 11:09:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7887ba27-3cab-5de4-ac81-f56c622e95c2, identifier: VX49143
2026-03-30 11:09:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7887ba27-3cab-5de4-ac81-f56c622e95c2 with identifier: VX49143
2026-03-30 11:09:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7887ba27-3cab-5de4-ac81-f56c622e95c2 with identifier: VX49143
2026-03-30 11:09:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7887ba27-3cab-5de4-ac81-f56c622e95c2 with identifier: VX49143 to the API
2026-03-30 11:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:27:19Z',
'fuel_type': 'petrol',
'id': '7887ba27-3cab-5de4-ac81-f56c622e95c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX49143',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'MiTo',
'odometer': 159457,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-27',
'seller_name': None,
'title': 'Alfa Romeo MiTo 1.4 Turbo Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2009}
2026-03-30 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX49143%27 HTTP/1.1" 200 None
2026-03-30 11:09:38 [auto1.fr] INFO: Saving data for VX49143: {'auction_closing_time': 1774970839.0, 'created_time': 1773075671.568967, 'last_price_update_time': 1774868978.909411}
2026-03-30 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VX49143') HTTP/1.1" 204 0
2026-03-30 11:09:38 [auto1.fr] INFO: Found listing with ID: FK23512
2026-03-30 11:09:38 [auto1.fr] INFO: Found listing with ID: XC31487
2026-03-30 11:09:38 [auto1.fr] INFO: Found listing with ID: JN15401
2026-03-30 11:09:38 [auto1.fr] INFO: Found listing with ID: CX38977
2026-03-30 11:09:38 [auto1.fr] INFO: Found listing with ID: SV36178
2026-03-30 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV36178%27 HTTP/1.1" 200 None
2026-03-30 11:09:38 [auto1.fr] INFO: Scrape type for SV36178: 2
2026-03-30 11:09:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0ad89f7-0168-588c-a29d-805217fb0ec5 with identifier: SV36178
2026-03-30 11:09:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0ad89f7-0168-588c-a29d-805217fb0ec5 with scrape type 2
2026-03-30 11:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0ad89f7-0168-588c-a29d-805217fb0ec5 with scrape type 2
2026-03-30 11:09:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a0ad89f7-0168-588c-a29d-805217fb0ec5, identifier: SV36178
2026-03-30 11:09:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a0ad89f7-0168-588c-a29d-805217fb0ec5 with identifier: SV36178
2026-03-30 11:09:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a0ad89f7-0168-588c-a29d-805217fb0ec5 with identifier: SV36178
2026-03-30 11:09:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a0ad89f7-0168-588c-a29d-805217fb0ec5 with identifier: SV36178 to the API
2026-03-30 11:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-31T15:27:30Z',
'fuel_type': 'petrol',
'id': 'a0ad89f7-0168-588c-a29d-805217fb0ec5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV36178',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 82122,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-06',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 250 Shooting Brake 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2020}
2026-03-30 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV36178%27 HTTP/1.1" 200 None
2026-03-30 11:09:39 [auto1.fr] INFO: Saving data for SV36178: {'auction_closing_time': 1774970850.0, 'created_time': 1773745736.290726, 'last_price_update_time': 1774868979.537016}
2026-03-30 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SV36178') HTTP/1.1" 204 0
2026-03-30 11:09:39 [auto1.fr] INFO: Found listing with ID: DS08848
2026-03-30 11:09:39 [auto1.fr] INFO: Found listing with ID: TA72470
2026-03-30 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA72470%27 HTTP/1.1" 200 None
2026-03-30 11:09:39 [auto1.fr] INFO: Scrape type for TA72470: 2
2026-03-30 11:09:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10d28700-242a-57fb-b483-3cd2da3011f8 with identifier: TA72470
2026-03-30 11:09:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10d28700-242a-57fb-b483-3cd2da3011f8 with scrape type 2
2026-03-30 11:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10d28700-242a-57fb-b483-3cd2da3011f8 with scrape type 2
2026-03-30 11:09:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 10d28700-242a-57fb-b483-3cd2da3011f8, identifier: TA72470
2026-03-30 11:09:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 10d28700-242a-57fb-b483-3cd2da3011f8 with identifier: TA72470
2026-03-30 11:09:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 10d28700-242a-57fb-b483-3cd2da3011f8 with identifier: TA72470
2026-03-30 11:09:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 10d28700-242a-57fb-b483-3cd2da3011f8 with identifier: TA72470 to the API
2026-03-30 11:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:12:13Z',
'fuel_type': 'diesel',
'id': '10d28700-242a-57fb-b483-3cd2da3011f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA72470',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 189815,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-06',
'seller_name': None,
'title': 'Peugeot 308 1.6 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2017}
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA72470%27 HTTP/1.1" 200 None
2026-03-30 11:09:40 [auto1.fr] INFO: Saving data for TA72470: {'auction_closing_time': 1774969933.0, 'created_time': 1774296400.943437, 'last_price_update_time': 1774868980.057724}
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TA72470') HTTP/1.1" 204 0
2026-03-30 11:09:40 [auto1.fr] INFO: Found listing with ID: VV44439
2026-03-30 11:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WZ42856/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UN11275/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH81493> (referer: https://www.auto1.com/v1/car-details-view/BH81493/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62f91791-4d2e-5b56-93ef-03db18526581 with identifier: BH81493
2026-03-30 11:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62f91791-4d2e-5b56-93ef-03db18526581 with scrape type 1
2026-03-30 11:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 62f91791-4d2e-5b56-93ef-03db18526581
2026-03-30 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb7%252F90b738860d2b50fad86c92a42b90f16c%252Fpa%252FBH81493_6ea08de59b042299601fae01ac677fb3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b7/90b738860d2b50fad86c92a42b90f16c/pa/BH81493_6ea08de59b042299601fae01ac677fb3.jpg already downloaded
2026-03-30 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb7%252F90b738860d2b50fad86c92a42b90f16c%252Fpa%252FBH81493_7820bb84fa7d756e88e88fa07e717fdb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b7/90b738860d2b50fad86c92a42b90f16c/pa/BH81493_7820bb84fa7d756e88e88fa07e717fdb.jpg already downloaded
2026-03-30 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb7%252F90b738860d2b50fad86c92a42b90f16c%252Fpa%252FBH81493_1b994dfc6bf0b1ad279d35fb2484c86f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b7/90b738860d2b50fad86c92a42b90f16c/pa/BH81493_1b994dfc6bf0b1ad279d35fb2484c86f.jpg already downloaded
2026-03-30 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb7%252F90b738860d2b50fad86c92a42b90f16c%252Fpa%252FBH81493_1315bf87b804cb446ccd1da8f8d409fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b7/90b738860d2b50fad86c92a42b90f16c/pa/BH81493_1315bf87b804cb446ccd1da8f8d409fc.jpg already downloaded
2026-03-30 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb7%252F90b738860d2b50fad86c92a42b90f16c%252Fpa%252FBH81493_8baa145227a6878597f2f685ddf9cd58.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b7/90b738860d2b50fad86c92a42b90f16c/pa/BH81493_8baa145227a6878597f2f685ddf9cd58.jpg already downloaded
2026-03-30 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb7%252F90b738860d2b50fad86c92a42b90f16c%252Fpa%252FBH81493_08702529e7b2111f4aab20e47c4c8bfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b7/90b738860d2b50fad86c92a42b90f16c/pa/BH81493_08702529e7b2111f4aab20e47c4c8bfc.jpg already downloaded
2026-03-30 11:09:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 62f91791-4d2e-5b56-93ef-03db18526581, identifier: BH81493
2026-03-30 11:09:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 62f91791-4d2e-5b56-93ef-03db18526581 with identifier: BH81493
2026-03-30 11:09:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 62f91791-4d2e-5b56-93ef-03db18526581 with identifier: BH81493
2026-03-30 11:09:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 62f91791-4d2e-5b56-93ef-03db18526581 with identifier: BH81493 to the API
2026-03-30 11:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BH81493>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:02:54Z',
'fuel_type': 'diesel',
'id': '62f91791-4d2e-5b56-93ef-03db18526581',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH81493',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Toyota',
'model': 'Auris',
'odometer': 252601,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img90/b7/90b738860d2b50fad86c92a42b90f16c/pa/BH81493_6ea08de59b042299601fae01ac677fb3.jpg',
'https://img-pa.auto1.com/img90/b7/90b738860d2b50fad86c92a42b90f16c/pa/BH81493_7820bb84fa7d756e88e88fa07e717fdb.jpg',
'https://img-pa.auto1.com/img90/b7/90b738860d2b50fad86c92a42b90f16c/pa/BH81493_1b994dfc6bf0b1ad279d35fb2484c86f.jpg',
'https://img-pa.auto1.com/img90/b7/90b738860d2b50fad86c92a42b90f16c/pa/BH81493_1315bf87b804cb446ccd1da8f8d409fc.jpg',
'https://img-pa.auto1.com/img90/b7/90b738860d2b50fad86c92a42b90f16c/pa/BH81493_8baa145227a6878597f2f685ddf9cd58.jpg',
'https://img-pa.auto1.com/img90/b7/90b738860d2b50fad86c92a42b90f16c/pa/BH81493_08702529e7b2111f4aab20e47c4c8bfc.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62f91791-4d2e-5b56-93ef-03db18526581/62f91791-4d2e-5b56-93ef-03db18526581_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72601,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/b7/90b738860d2b50fad86c92a42b90f16c/pa/BH81493_6ea08de59b042299601fae01ac677fb3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62f91791-4d2e-5b56-93ef-03db18526581/62f91791-4d2e-5b56-93ef-03db18526581_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70239,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/b7/90b738860d2b50fad86c92a42b90f16c/pa/BH81493_7820bb84fa7d756e88e88fa07e717fdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62f91791-4d2e-5b56-93ef-03db18526581/62f91791-4d2e-5b56-93ef-03db18526581_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76454,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/b7/90b738860d2b50fad86c92a42b90f16c/pa/BH81493_1b994dfc6bf0b1ad279d35fb2484c86f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62f91791-4d2e-5b56-93ef-03db18526581/62f91791-4d2e-5b56-93ef-03db18526581_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80310,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/b7/90b738860d2b50fad86c92a42b90f16c/pa/BH81493_1315bf87b804cb446ccd1da8f8d409fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62f91791-4d2e-5b56-93ef-03db18526581/62f91791-4d2e-5b56-93ef-03db18526581_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93214,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/b7/90b738860d2b50fad86c92a42b90f16c/pa/BH81493_8baa145227a6878597f2f685ddf9cd58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62f91791-4d2e-5b56-93ef-03db18526581/62f91791-4d2e-5b56-93ef-03db18526581_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/b7/90b738860d2b50fad86c92a42b90f16c/pa/BH81493_08702529e7b2111f4aab20e47c4c8bfc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-02-22',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Auris 1.4 Turbodiesel Sportline',
'transmission': 'manual',
'trim': 'Sportline',
'year': 2011}
2026-03-30 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH81493%27 HTTP/1.1" 200 None
2026-03-30 11:09:48 [auto1.fr] INFO: Saving data for BH81493: {'created_time': 1774868988.660852, 'last_price_update_time': 1774868988.660862, 'auction_closing_time': 1774969374.0}
2026-03-30 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BH81493') HTTP/1.1" 204 0
2026-03-30 11:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ED93860> (referer: https://www.auto1.com/v1/car-details-view/ED93860/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5f4cbbf-7790-50b0-b21c-b7225517d794 with identifier: ED93860
2026-03-30 11:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5f4cbbf-7790-50b0-b21c-b7225517d794 with scrape type 1
2026-03-30 11:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d5f4cbbf-7790-50b0-b21c-b7225517d794
2026-03-30 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F39%252F8539ae4d46c5ff46814819f6d6882732%252Fpa%252FED93860_bbade28c5c84ce16816f3c1efea452c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/39/8539ae4d46c5ff46814819f6d6882732/pa/ED93860_bbade28c5c84ce16816f3c1efea452c1.jpg already downloaded
2026-03-30 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F39%252F8539ae4d46c5ff46814819f6d6882732%252Fpa%252FED93860_c4ca4ac51e8b0f34e58119825eabdc3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/39/8539ae4d46c5ff46814819f6d6882732/pa/ED93860_c4ca4ac51e8b0f34e58119825eabdc3b.jpg already downloaded
2026-03-30 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F39%252F8539ae4d46c5ff46814819f6d6882732%252Fpa%252FED93860_12776fc2615cfda4b50ac233b03d1127.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/39/8539ae4d46c5ff46814819f6d6882732/pa/ED93860_12776fc2615cfda4b50ac233b03d1127.jpg already downloaded
2026-03-30 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F39%252F8539ae4d46c5ff46814819f6d6882732%252Fpa%252FED93860_a45bc05b96b39c30edaa46ee0e4898ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/39/8539ae4d46c5ff46814819f6d6882732/pa/ED93860_a45bc05b96b39c30edaa46ee0e4898ff.jpg already downloaded
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F39%252F8539ae4d46c5ff46814819f6d6882732%252Fpa%252FED93860_e31b9d246e79f786c2c53b37d72f4120.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/39/8539ae4d46c5ff46814819f6d6882732/pa/ED93860_e31b9d246e79f786c2c53b37d72f4120.jpg already downloaded
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F39%252F8539ae4d46c5ff46814819f6d6882732%252Fpa%252FED93860_d794342958028d698cdd444bbfbcb130.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/39/8539ae4d46c5ff46814819f6d6882732/pa/ED93860_d794342958028d698cdd444bbfbcb130.jpg already downloaded
2026-03-30 11:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d5f4cbbf-7790-50b0-b21c-b7225517d794, identifier: ED93860
2026-03-30 11:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d5f4cbbf-7790-50b0-b21c-b7225517d794 with identifier: ED93860
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d5f4cbbf-7790-50b0-b21c-b7225517d794 with identifier: ED93860
2026-03-30 11:09:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d5f4cbbf-7790-50b0-b21c-b7225517d794 with identifier: ED93860 to the API
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ED93860>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:28:30Z',
'fuel_type': 'diesel',
'id': 'd5f4cbbf-7790-50b0-b21c-b7225517d794',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED93860',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'MINI',
'model': 'MINI',
'odometer': 276844,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img85/39/8539ae4d46c5ff46814819f6d6882732/pa/ED93860_bbade28c5c84ce16816f3c1efea452c1.jpg',
'https://img-pa.auto1.com/img85/39/8539ae4d46c5ff46814819f6d6882732/pa/ED93860_c4ca4ac51e8b0f34e58119825eabdc3b.jpg',
'https://img-pa.auto1.com/img85/39/8539ae4d46c5ff46814819f6d6882732/pa/ED93860_12776fc2615cfda4b50ac233b03d1127.jpg',
'https://img-pa.auto1.com/img85/39/8539ae4d46c5ff46814819f6d6882732/pa/ED93860_a45bc05b96b39c30edaa46ee0e4898ff.jpg',
'https://img-pa.auto1.com/img85/39/8539ae4d46c5ff46814819f6d6882732/pa/ED93860_e31b9d246e79f786c2c53b37d72f4120.jpg',
'https://img-pa.auto1.com/img85/39/8539ae4d46c5ff46814819f6d6882732/pa/ED93860_d794342958028d698cdd444bbfbcb130.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f4cbbf-7790-50b0-b21c-b7225517d794/d5f4cbbf-7790-50b0-b21c-b7225517d794_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67347,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/39/8539ae4d46c5ff46814819f6d6882732/pa/ED93860_bbade28c5c84ce16816f3c1efea452c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f4cbbf-7790-50b0-b21c-b7225517d794/d5f4cbbf-7790-50b0-b21c-b7225517d794_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/39/8539ae4d46c5ff46814819f6d6882732/pa/ED93860_c4ca4ac51e8b0f34e58119825eabdc3b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f4cbbf-7790-50b0-b21c-b7225517d794/d5f4cbbf-7790-50b0-b21c-b7225517d794_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78034,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/39/8539ae4d46c5ff46814819f6d6882732/pa/ED93860_12776fc2615cfda4b50ac233b03d1127.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f4cbbf-7790-50b0-b21c-b7225517d794/d5f4cbbf-7790-50b0-b21c-b7225517d794_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/39/8539ae4d46c5ff46814819f6d6882732/pa/ED93860_a45bc05b96b39c30edaa46ee0e4898ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f4cbbf-7790-50b0-b21c-b7225517d794/d5f4cbbf-7790-50b0-b21c-b7225517d794_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62529,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/39/8539ae4d46c5ff46814819f6d6882732/pa/ED93860_e31b9d246e79f786c2c53b37d72f4120.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f4cbbf-7790-50b0-b21c-b7225517d794/d5f4cbbf-7790-50b0-b21c-b7225517d794_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/39/8539ae4d46c5ff46814819f6d6882732/pa/ED93860_d794342958028d698cdd444bbfbcb130.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-09-27',
'seats_number': 4,
'seller_name': None,
'title': 'MINI One D',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED93860%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [auto1.fr] INFO: Saving data for ED93860: {'created_time': 1774868990.655465, 'last_price_update_time': 1774868990.655474, 'auction_closing_time': 1774970910.0}
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ED93860') HTTP/1.1" 204 0
2026-03-30 11:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PY98810/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WS97350> (referer: https://www.auto1.com/v1/car-details-view/WS97350/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e273b204-7c45-584c-9dfd-0654acc87064 with identifier: WS97350
2026-03-30 11:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e273b204-7c45-584c-9dfd-0654acc87064 with scrape type 1
2026-03-30 11:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e273b204-7c45-584c-9dfd-0654acc87064
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fcb%252F45cb25f49237e401ad874860e9ba0b01%252Fpa%252FWS97350_1488916183ca2644bfafd5f608de8f8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_1488916183ca2644bfafd5f608de8f8a.jpg already downloaded
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fcb%252F45cb25f49237e401ad874860e9ba0b01%252Fpa%252FWS97350_bb1eaf6f778e9085d271e9f0c3df8318.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_bb1eaf6f778e9085d271e9f0c3df8318.jpg already downloaded
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fcb%252F45cb25f49237e401ad874860e9ba0b01%252Fpa%252FWS97350_d8ecaa1278c7e09ad9eac450ca315192.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_d8ecaa1278c7e09ad9eac450ca315192.jpg already downloaded
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fcb%252F45cb25f49237e401ad874860e9ba0b01%252Fpa%252FWS97350_875db5642a810c97426cc921ca7efc01.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_875db5642a810c97426cc921ca7efc01.jpg already downloaded
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fcb%252F45cb25f49237e401ad874860e9ba0b01%252Fpa%252FWS97350_2a193e1d91c139c64fec1c8cab1e461e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_2a193e1d91c139c64fec1c8cab1e461e.jpg already downloaded
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fcb%252F45cb25f49237e401ad874860e9ba0b01%252Fpa%252FWS97350_7f897b49638a846ff94d5a7143fc8731.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_7f897b49638a846ff94d5a7143fc8731.jpg already downloaded
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fcb%252F45cb25f49237e401ad874860e9ba0b01%252Fpa%252FWS97350_a9b44b7e0af10920d0d17a9f2ddf12b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_a9b44b7e0af10920d0d17a9f2ddf12b8.jpg already downloaded
2026-03-30 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fcb%252F45cb25f49237e401ad874860e9ba0b01%252Fpa%252FWS97350_5cda6947f77cf78c6a94b40cf37d7949.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_5cda6947f77cf78c6a94b40cf37d7949.jpg already downloaded
2026-03-30 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fcb%252F45cb25f49237e401ad874860e9ba0b01%252Fpa%252FWS97350_a38bbfc50da986d282d09ee2af5ada5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_a38bbfc50da986d282d09ee2af5ada5f.jpg already downloaded
2026-03-30 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fcb%252F45cb25f49237e401ad874860e9ba0b01%252Fpa%252FWS97350_f9f57bbff180a2beb24d10761ed45a8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_f9f57bbff180a2beb24d10761ed45a8c.jpg already downloaded
2026-03-30 11:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e273b204-7c45-584c-9dfd-0654acc87064, identifier: WS97350
2026-03-30 11:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e273b204-7c45-584c-9dfd-0654acc87064 with identifier: WS97350
2026-03-30 11:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e273b204-7c45-584c-9dfd-0654acc87064 with identifier: WS97350
2026-03-30 11:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e273b204-7c45-584c-9dfd-0654acc87064 with identifier: WS97350 to the API
2026-03-30 11:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WS97350>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:27:06Z',
'fuel_type': 'diesel',
'id': 'e273b204-7c45-584c-9dfd-0654acc87064',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS97350',
'listing': 'auction',
'location': 'FR, Marly-la-ville',
'make': 'Volvo',
'model': 'XC40',
'odometer': 143300,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_1488916183ca2644bfafd5f608de8f8a.jpg',
'https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_bb1eaf6f778e9085d271e9f0c3df8318.jpg',
'https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_d8ecaa1278c7e09ad9eac450ca315192.jpg',
'https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_875db5642a810c97426cc921ca7efc01.jpg',
'https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_2a193e1d91c139c64fec1c8cab1e461e.jpg',
'https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_7f897b49638a846ff94d5a7143fc8731.jpg',
'https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_a9b44b7e0af10920d0d17a9f2ddf12b8.jpg',
'https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_5cda6947f77cf78c6a94b40cf37d7949.jpg',
'https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_a38bbfc50da986d282d09ee2af5ada5f.jpg',
'https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_f9f57bbff180a2beb24d10761ed45a8c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e273b204-7c45-584c-9dfd-0654acc87064/e273b204-7c45-584c-9dfd-0654acc87064_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92407,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_1488916183ca2644bfafd5f608de8f8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e273b204-7c45-584c-9dfd-0654acc87064/e273b204-7c45-584c-9dfd-0654acc87064_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_bb1eaf6f778e9085d271e9f0c3df8318.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e273b204-7c45-584c-9dfd-0654acc87064/e273b204-7c45-584c-9dfd-0654acc87064_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_d8ecaa1278c7e09ad9eac450ca315192.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e273b204-7c45-584c-9dfd-0654acc87064/e273b204-7c45-584c-9dfd-0654acc87064_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62023,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_875db5642a810c97426cc921ca7efc01.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e273b204-7c45-584c-9dfd-0654acc87064/e273b204-7c45-584c-9dfd-0654acc87064_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_2a193e1d91c139c64fec1c8cab1e461e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e273b204-7c45-584c-9dfd-0654acc87064/e273b204-7c45-584c-9dfd-0654acc87064_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91542,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_7f897b49638a846ff94d5a7143fc8731.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e273b204-7c45-584c-9dfd-0654acc87064/e273b204-7c45-584c-9dfd-0654acc87064_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82279,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_a9b44b7e0af10920d0d17a9f2ddf12b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e273b204-7c45-584c-9dfd-0654acc87064/e273b204-7c45-584c-9dfd-0654acc87064_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106546,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_5cda6947f77cf78c6a94b40cf37d7949.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e273b204-7c45-584c-9dfd-0654acc87064/e273b204-7c45-584c-9dfd-0654acc87064_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93846,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_a38bbfc50da986d282d09ee2af5ada5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e273b204-7c45-584c-9dfd-0654acc87064/e273b204-7c45-584c-9dfd-0654acc87064_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/cb/45cb25f49237e401ad874860e9ba0b01/pa/WS97350_f9f57bbff180a2beb24d10761ed45a8c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-04-02',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC40 2.0 D4 Momentum AWD',
'transmission': 'automatic',
'trim': 'Momentum AWD',
'year': 2018}
2026-03-30 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS97350%27 HTTP/1.1" 200 None
2026-03-30 11:09:59 [auto1.fr] INFO: Saving data for WS97350: {'created_time': 1774868999.476425, 'last_price_update_time': 1774868999.476436, 'auction_closing_time': 1774970826.0}
2026-03-30 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WS97350') HTTP/1.1" 204 0
2026-03-30 11:10:05 [scrapy.extensions.logstats] INFO: Crawled 30 pages (at 23 pages/min), scraped 24 items (at 21 items/min)
2026-03-30 11:10:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-30 11:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CR02968> (referer: https://www.auto1.com/v1/car-details-view/CR02968/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20a4ec55-6134-554d-acba-2119d4cf7ed3 with identifier: CR02968
2026-03-30 11:10:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20a4ec55-6134-554d-acba-2119d4cf7ed3 with scrape type 1
2026-03-30 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 20a4ec55-6134-554d-acba-2119d4cf7ed3
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F6b%252Fa06bf94f65fa872f79250766a2b4d595%252Fpa%252FCR02968_2e6d9985fb2df0fefb664e1ebfc29b75.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_2e6d9985fb2df0fefb664e1ebfc29b75.jpg already downloaded
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F6b%252Fa06bf94f65fa872f79250766a2b4d595%252Fpa%252FCR02968_203ec517941e391a476118c908738002.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_203ec517941e391a476118c908738002.jpg already downloaded
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F6b%252Fa06bf94f65fa872f79250766a2b4d595%252Fpa%252FCR02968_82173bf4030d7dd7bbd4e722da6ff566.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_82173bf4030d7dd7bbd4e722da6ff566.jpg already downloaded
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F6b%252Fa06bf94f65fa872f79250766a2b4d595%252Fpa%252FCR02968_b1382ec7ae73fe5144abce7f4110f1a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_b1382ec7ae73fe5144abce7f4110f1a4.jpg already downloaded
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F6b%252Fa06bf94f65fa872f79250766a2b4d595%252Fpa%252FCR02968_24c9d679dc22ae44f83de360f2ee94c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_24c9d679dc22ae44f83de360f2ee94c2.jpg already downloaded
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F6b%252Fa06bf94f65fa872f79250766a2b4d595%252Fpa%252FCR02968_af6b396c0376603d5772f9766b0768de.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_af6b396c0376603d5772f9766b0768de.jpg already downloaded
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F6b%252Fa06bf94f65fa872f79250766a2b4d595%252Fpa%252FCR02968_0eee8aa9c2856540ccd2e928939811c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_0eee8aa9c2856540ccd2e928939811c3.jpg already downloaded
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F6b%252Fa06bf94f65fa872f79250766a2b4d595%252Fpa%252FCR02968_aa41e19d2ed9e62594ada928a1176250.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_aa41e19d2ed9e62594ada928a1176250.jpg already downloaded
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F6b%252Fa06bf94f65fa872f79250766a2b4d595%252Fpa%252FCR02968_0e711ce2e3140a6546c89a0dcaf14de1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_0e711ce2e3140a6546c89a0dcaf14de1.jpg already downloaded
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F6b%252Fa06bf94f65fa872f79250766a2b4d595%252Fpa%252FCR02968_49db5a9cb433ed7211a240eeb03fbb2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_49db5a9cb433ed7211a240eeb03fbb2a.jpg already downloaded
2026-03-30 11:10:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 20a4ec55-6134-554d-acba-2119d4cf7ed3, identifier: CR02968
2026-03-30 11:10:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 20a4ec55-6134-554d-acba-2119d4cf7ed3 with identifier: CR02968
2026-03-30 11:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 20a4ec55-6134-554d-acba-2119d4cf7ed3 with identifier: CR02968
2026-03-30 11:10:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 20a4ec55-6134-554d-acba-2119d4cf7ed3 with identifier: CR02968 to the API
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CR02968>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 92,
'expiration_date': '2026-03-31T15:38:34Z',
'fuel_type': 'diesel',
'id': '20a4ec55-6134-554d-acba-2119d4cf7ed3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR02968',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Citroen',
'model': 'C4',
'odometer': 164274,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_2e6d9985fb2df0fefb664e1ebfc29b75.jpg',
'https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_203ec517941e391a476118c908738002.jpg',
'https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_82173bf4030d7dd7bbd4e722da6ff566.jpg',
'https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_b1382ec7ae73fe5144abce7f4110f1a4.jpg',
'https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_24c9d679dc22ae44f83de360f2ee94c2.jpg',
'https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_af6b396c0376603d5772f9766b0768de.jpg',
'https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_0eee8aa9c2856540ccd2e928939811c3.jpg',
'https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_aa41e19d2ed9e62594ada928a1176250.jpg',
'https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_0e711ce2e3140a6546c89a0dcaf14de1.jpg',
'https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_49db5a9cb433ed7211a240eeb03fbb2a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a4ec55-6134-554d-acba-2119d4cf7ed3/20a4ec55-6134-554d-acba-2119d4cf7ed3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47217,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_2e6d9985fb2df0fefb664e1ebfc29b75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a4ec55-6134-554d-acba-2119d4cf7ed3/20a4ec55-6134-554d-acba-2119d4cf7ed3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107343,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_203ec517941e391a476118c908738002.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a4ec55-6134-554d-acba-2119d4cf7ed3/20a4ec55-6134-554d-acba-2119d4cf7ed3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111540,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_82173bf4030d7dd7bbd4e722da6ff566.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a4ec55-6134-554d-acba-2119d4cf7ed3/20a4ec55-6134-554d-acba-2119d4cf7ed3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_b1382ec7ae73fe5144abce7f4110f1a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a4ec55-6134-554d-acba-2119d4cf7ed3/20a4ec55-6134-554d-acba-2119d4cf7ed3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43728,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_24c9d679dc22ae44f83de360f2ee94c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a4ec55-6134-554d-acba-2119d4cf7ed3/20a4ec55-6134-554d-acba-2119d4cf7ed3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48630,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_af6b396c0376603d5772f9766b0768de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a4ec55-6134-554d-acba-2119d4cf7ed3/20a4ec55-6134-554d-acba-2119d4cf7ed3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44929,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_0eee8aa9c2856540ccd2e928939811c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a4ec55-6134-554d-acba-2119d4cf7ed3/20a4ec55-6134-554d-acba-2119d4cf7ed3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99109,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_aa41e19d2ed9e62594ada928a1176250.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a4ec55-6134-554d-acba-2119d4cf7ed3/20a4ec55-6134-554d-acba-2119d4cf7ed3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53938,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_0e711ce2e3140a6546c89a0dcaf14de1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a4ec55-6134-554d-acba-2119d4cf7ed3/20a4ec55-6134-554d-acba-2119d4cf7ed3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60689,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/6b/a06bf94f65fa872f79250766a2b4d595/pa/CR02968_49db5a9cb433ed7211a240eeb03fbb2a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Collection',
'transmission': 'manual',
'trim': 'Collection',
'year': 2014}
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR02968%27 HTTP/1.1" 200 None
2026-03-30 11:10:10 [auto1.fr] INFO: Saving data for CR02968: {'created_time': 1774869010.67038, 'last_price_update_time': 1774869010.670391, 'auction_closing_time': 1774971514.0}
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CR02968') HTTP/1.1" 204 0
2026-03-30 11:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD89512/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UN11275> (referer: https://www.auto1.com/v1/car-details-view/UN11275/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebd195a5-40fd-5599-995f-9333281c4861 with identifier: UN11275
2026-03-30 11:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebd195a5-40fd-5599-995f-9333281c4861 with scrape type 1
2026-03-30 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ebd195a5-40fd-5599-995f-9333281c4861
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F34%252Fc0343fd468e6f67120675546e603f33d%252Fpa%252FUN11275_cc868b047ed611966968382fc1c317f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_cc868b047ed611966968382fc1c317f3.jpg already downloaded
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F34%252Fc0343fd468e6f67120675546e603f33d%252Fpa%252FUN11275_b0490a03d5b6ee844ca99bf92e2102bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_b0490a03d5b6ee844ca99bf92e2102bf.jpg already downloaded
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F34%252Fc0343fd468e6f67120675546e603f33d%252Fpa%252FUN11275_1e2141d10e27f9f29fd5372ed2cf9d10.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_1e2141d10e27f9f29fd5372ed2cf9d10.jpg already downloaded
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F34%252Fc0343fd468e6f67120675546e603f33d%252Fpa%252FUN11275_811da653ac663352136d2a8ba6af21c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_811da653ac663352136d2a8ba6af21c0.jpg already downloaded
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F34%252Fc0343fd468e6f67120675546e603f33d%252Fpa%252FUN11275_9aa7465426a1ead290257fd732c568e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_9aa7465426a1ead290257fd732c568e3.jpg already downloaded
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F34%252Fc0343fd468e6f67120675546e603f33d%252Fpa%252FUN11275_4186d95a67a1dfc6a0fa0dec9e805276.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_4186d95a67a1dfc6a0fa0dec9e805276.jpg already downloaded
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F34%252Fc0343fd468e6f67120675546e603f33d%252Fpa%252FUN11275_ffd8fe45f20ca7b307e7a8cad9dac98d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_ffd8fe45f20ca7b307e7a8cad9dac98d.jpg already downloaded
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F34%252Fc0343fd468e6f67120675546e603f33d%252Fpa%252FUN11275_ffb81d3b9f15dd6e9ae1f38840f6002d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_ffb81d3b9f15dd6e9ae1f38840f6002d.jpg already downloaded
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F34%252Fc0343fd468e6f67120675546e603f33d%252Fpa%252FUN11275_2badcbdbf9ed900581fdc1b84b885a99.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_2badcbdbf9ed900581fdc1b84b885a99.jpg already downloaded
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F34%252Fc0343fd468e6f67120675546e603f33d%252Fpa%252FUN11275_b8d3b289734d515433244bf0396e276e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_b8d3b289734d515433244bf0396e276e.jpg already downloaded
2026-03-30 11:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ebd195a5-40fd-5599-995f-9333281c4861, identifier: UN11275
2026-03-30 11:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ebd195a5-40fd-5599-995f-9333281c4861 with identifier: UN11275
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 11:10:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ebd195a5-40fd-5599-995f-9333281c4861 with identifier: UN11275
2026-03-30 11:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ebd195a5-40fd-5599-995f-9333281c4861 with identifier: UN11275 to the API
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UN11275>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:21:47Z',
'fuel_type': 'petrol',
'id': 'ebd195a5-40fd-5599-995f-9333281c4861',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN11275',
'listing': 'auction',
'location': 'FR, Le Cellier',
'make': 'Peugeot',
'model': '2008',
'odometer': 32043,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_cc868b047ed611966968382fc1c317f3.jpg',
'https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_b0490a03d5b6ee844ca99bf92e2102bf.jpg',
'https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_1e2141d10e27f9f29fd5372ed2cf9d10.jpg',
'https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_811da653ac663352136d2a8ba6af21c0.jpg',
'https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_9aa7465426a1ead290257fd732c568e3.jpg',
'https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_4186d95a67a1dfc6a0fa0dec9e805276.jpg',
'https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_ffd8fe45f20ca7b307e7a8cad9dac98d.jpg',
'https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_ffb81d3b9f15dd6e9ae1f38840f6002d.jpg',
'https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_2badcbdbf9ed900581fdc1b84b885a99.jpg',
'https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_b8d3b289734d515433244bf0396e276e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd195a5-40fd-5599-995f-9333281c4861/ebd195a5-40fd-5599-995f-9333281c4861_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302995,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_cc868b047ed611966968382fc1c317f3.jpg',
'Width': 1200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd195a5-40fd-5599-995f-9333281c4861/ebd195a5-40fd-5599-995f-9333281c4861_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_b0490a03d5b6ee844ca99bf92e2102bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd195a5-40fd-5599-995f-9333281c4861/ebd195a5-40fd-5599-995f-9333281c4861_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307418,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_1e2141d10e27f9f29fd5372ed2cf9d10.jpg',
'Width': 1200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd195a5-40fd-5599-995f-9333281c4861/ebd195a5-40fd-5599-995f-9333281c4861_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307749,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_811da653ac663352136d2a8ba6af21c0.jpg',
'Width': 1200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd195a5-40fd-5599-995f-9333281c4861/ebd195a5-40fd-5599-995f-9333281c4861_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272486,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_9aa7465426a1ead290257fd732c568e3.jpg',
'Width': 1200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd195a5-40fd-5599-995f-9333281c4861/ebd195a5-40fd-5599-995f-9333281c4861_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_4186d95a67a1dfc6a0fa0dec9e805276.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd195a5-40fd-5599-995f-9333281c4861/ebd195a5-40fd-5599-995f-9333281c4861_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55745,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_ffd8fe45f20ca7b307e7a8cad9dac98d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd195a5-40fd-5599-995f-9333281c4861/ebd195a5-40fd-5599-995f-9333281c4861_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307382,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_ffb81d3b9f15dd6e9ae1f38840f6002d.jpg',
'Width': 1200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd195a5-40fd-5599-995f-9333281c4861/ebd195a5-40fd-5599-995f-9333281c4861_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66624,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_2badcbdbf9ed900581fdc1b84b885a99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd195a5-40fd-5599-995f-9333281c4861/ebd195a5-40fd-5599-995f-9333281c4861_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/34/c0343fd468e6f67120675546e603f33d/pa/UN11275_b8d3b289734d515433244bf0396e276e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-10',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2019}
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN11275%27 HTTP/1.1" 200 None
2026-03-30 11:10:24 [auto1.fr] INFO: Saving data for UN11275: {'created_time': 1774869024.071701, 'last_price_update_time': 1774869024.071711, 'auction_closing_time': 1774970507.0}
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UN11275') HTTP/1.1" 204 0
2026-03-30 11:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD89512> (referer: https://www.auto1.com/v1/car-details-view/ZD89512/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fd5e45d-db0c-527e-a343-cfebf26b7d44 with identifier: ZD89512
2026-03-30 11:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fd5e45d-db0c-527e-a343-cfebf26b7d44 with scrape type 1
2026-03-30 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2fd5e45d-db0c-527e-a343-cfebf26b7d44
2026-03-30 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6ab1a6c59afe61f1d5347c8c9aaba8%252Fpa%252FZD89512_eed49a7ea05a6a45e8341cd9a097e7ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6ab1a6c59afe61f1d5347c8c9aaba8/pa/ZD89512_eed49a7ea05a6a45e8341cd9a097e7ad.jpg already downloaded
2026-03-30 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6ab1a6c59afe61f1d5347c8c9aaba8%252Fpa%252FZD89512_8744becea29c089c1be159b22e7425f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6ab1a6c59afe61f1d5347c8c9aaba8/pa/ZD89512_8744becea29c089c1be159b22e7425f1.jpg already downloaded
2026-03-30 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6ab1a6c59afe61f1d5347c8c9aaba8%252Fpa%252FZD89512_25aa053a33717deb1c3963d176eb9c7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6ab1a6c59afe61f1d5347c8c9aaba8/pa/ZD89512_25aa053a33717deb1c3963d176eb9c7c.jpg already downloaded
2026-03-30 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6ab1a6c59afe61f1d5347c8c9aaba8%252Fpa%252FZD89512_13c057d46999341dadc9226e7abc8c20.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6ab1a6c59afe61f1d5347c8c9aaba8/pa/ZD89512_13c057d46999341dadc9226e7abc8c20.jpg already downloaded
2026-03-30 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6ab1a6c59afe61f1d5347c8c9aaba8%252Fpa%252FZD89512_d89dc08940998599f802faaa89988b70.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6ab1a6c59afe61f1d5347c8c9aaba8/pa/ZD89512_d89dc08940998599f802faaa89988b70.jpg already downloaded
2026-03-30 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6ab1a6c59afe61f1d5347c8c9aaba8%252Fpa%252FZD89512_7df889db2f5c1f56877077346c136a15.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6ab1a6c59afe61f1d5347c8c9aaba8/pa/ZD89512_7df889db2f5c1f56877077346c136a15.jpg already downloaded
2026-03-30 11:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2fd5e45d-db0c-527e-a343-cfebf26b7d44, identifier: ZD89512
2026-03-30 11:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2fd5e45d-db0c-527e-a343-cfebf26b7d44 with identifier: ZD89512
2026-03-30 11:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2fd5e45d-db0c-527e-a343-cfebf26b7d44 with identifier: ZD89512
2026-03-30 11:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2fd5e45d-db0c-527e-a343-cfebf26b7d44 with identifier: ZD89512 to the API
2026-03-30 11:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZD89512>
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:31:13Z',
'fuel_type': 'petrol',
'id': '2fd5e45d-db0c-527e-a343-cfebf26b7d44',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD89512',
'listing': 'auction',
'location': 'FR, LA CHAPELLE LONGUEVILLE',
'make': 'MINI',
'model': 'Clubman',
'odometer': 121336,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgeb/6a/eb6ab1a6c59afe61f1d5347c8c9aaba8/pa/ZD89512_eed49a7ea05a6a45e8341cd9a097e7ad.jpg',
'https://img-pa.auto1.com/imgeb/6a/eb6ab1a6c59afe61f1d5347c8c9aaba8/pa/ZD89512_8744becea29c089c1be159b22e7425f1.jpg',
'https://img-pa.auto1.com/imgeb/6a/eb6ab1a6c59afe61f1d5347c8c9aaba8/pa/ZD89512_25aa053a33717deb1c3963d176eb9c7c.jpg',
'https://img-pa.auto1.com/imgeb/6a/eb6ab1a6c59afe61f1d5347c8c9aaba8/pa/ZD89512_13c057d46999341dadc9226e7abc8c20.jpg',
'https://img-pa.auto1.com/imgeb/6a/eb6ab1a6c59afe61f1d5347c8c9aaba8/pa/ZD89512_d89dc08940998599f802faaa89988b70.jpg',
'https://img-pa.auto1.com/imgeb/6a/eb6ab1a6c59afe61f1d5347c8c9aaba8/pa/ZD89512_7df889db2f5c1f56877077346c136a15.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fd5e45d-db0c-527e-a343-cfebf26b7d44/2fd5e45d-db0c-527e-a343-cfebf26b7d44_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6ab1a6c59afe61f1d5347c8c9aaba8/pa/ZD89512_eed49a7ea05a6a45e8341cd9a097e7ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fd5e45d-db0c-527e-a343-cfebf26b7d44/2fd5e45d-db0c-527e-a343-cfebf26b7d44_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68558,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6ab1a6c59afe61f1d5347c8c9aaba8/pa/ZD89512_8744becea29c089c1be159b22e7425f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fd5e45d-db0c-527e-a343-cfebf26b7d44/2fd5e45d-db0c-527e-a343-cfebf26b7d44_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77736,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6ab1a6c59afe61f1d5347c8c9aaba8/pa/ZD89512_25aa053a33717deb1c3963d176eb9c7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fd5e45d-db0c-527e-a343-cfebf26b7d44/2fd5e45d-db0c-527e-a343-cfebf26b7d44_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73333,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6ab1a6c59afe61f1d5347c8c9aaba8/pa/ZD89512_13c057d46999341dadc9226e7abc8c20.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fd5e45d-db0c-527e-a343-cfebf26b7d44/2fd5e45d-db0c-527e-a343-cfebf26b7d44_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6ab1a6c59afe61f1d5347c8c9aaba8/pa/ZD89512_d89dc08940998599f802faaa89988b70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fd5e45d-db0c-527e-a343-cfebf26b7d44/2fd5e45d-db0c-527e-a343-cfebf26b7d44_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63543,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6ab1a6c59afe61f1d5347c8c9aaba8/pa/ZD89512_7df889db2f5c1f56877077346c136a15.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-12-23',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Clubman One',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-30 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD89512%27 HTTP/1.1" 200 None
2026-03-30 11:10:33 [auto1.fr] INFO: Saving data for ZD89512: {'created_time': 1774869033.02058, 'last_price_update_time': 1774869033.020591, 'auction_closing_time': 1774971073.0}
2026-03-30 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZD89512') HTTP/1.1" 204 0
2026-03-30 11:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PY98810> (referer: https://www.auto1.com/v1/car-details-view/PY98810/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a039315f-6826-5beb-ac21-2350b7aeae6e with identifier: PY98810
2026-03-30 11:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a039315f-6826-5beb-ac21-2350b7aeae6e with scrape type 1
2026-03-30 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a039315f-6826-5beb-ac21-2350b7aeae6e
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F34%252F0234d852408a9686b9a9286c56b0e0fa%252Fpa%252FPY98810_041dad3fe529e087dd8ae55fd4449959.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_041dad3fe529e087dd8ae55fd4449959.jpg already downloaded
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F34%252F0234d852408a9686b9a9286c56b0e0fa%252Fpa%252FPY98810_bb3738ed7df67b2b1d018e458d3ee5f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_bb3738ed7df67b2b1d018e458d3ee5f9.jpg already downloaded
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F34%252F0234d852408a9686b9a9286c56b0e0fa%252Fpa%252FPY98810_b9cc9355813dc2d671e647e63fe5fda8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_b9cc9355813dc2d671e647e63fe5fda8.jpg already downloaded
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F34%252F0234d852408a9686b9a9286c56b0e0fa%252Fpa%252FPY98810_de2c54b2aad6b4febb84372470a2c810.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_de2c54b2aad6b4febb84372470a2c810.jpg already downloaded
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F34%252F0234d852408a9686b9a9286c56b0e0fa%252Fpa%252FPY98810_81f85157b295922532999ec6eccb8173.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_81f85157b295922532999ec6eccb8173.jpg already downloaded
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F34%252F0234d852408a9686b9a9286c56b0e0fa%252Fpa%252FPY98810_7d697ab1d3018865eee5c5af1cdcf589.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_7d697ab1d3018865eee5c5af1cdcf589.jpg already downloaded
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F34%252F0234d852408a9686b9a9286c56b0e0fa%252Fpa%252FPY98810_42538b9f7d908bbb341ddc63af695e49.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_42538b9f7d908bbb341ddc63af695e49.jpg already downloaded
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F34%252F0234d852408a9686b9a9286c56b0e0fa%252Fpa%252FPY98810_b8ecd76e22209fb5802cc507c54ef59f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_b8ecd76e22209fb5802cc507c54ef59f.jpg already downloaded
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F34%252F0234d852408a9686b9a9286c56b0e0fa%252Fpa%252FPY98810_df1b4290cf9e4852faa490fca7fe5821.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_df1b4290cf9e4852faa490fca7fe5821.jpg already downloaded
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F34%252F0234d852408a9686b9a9286c56b0e0fa%252Fpa%252FPY98810_c2048119afffb420220d1c139a110b06.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_c2048119afffb420220d1c139a110b06.jpg already downloaded
2026-03-30 11:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a039315f-6826-5beb-ac21-2350b7aeae6e, identifier: PY98810
2026-03-30 11:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a039315f-6826-5beb-ac21-2350b7aeae6e with identifier: PY98810
2026-03-30 11:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a039315f-6826-5beb-ac21-2350b7aeae6e with identifier: PY98810
2026-03-30 11:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a039315f-6826-5beb-ac21-2350b7aeae6e with identifier: PY98810 to the API
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PY98810>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:18:36Z',
'fuel_type': 'diesel',
'id': 'a039315f-6826-5beb-ac21-2350b7aeae6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY98810',
'listing': 'auction',
'location': 'FR, Saint Aignan de Grandlieu',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 183648,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_041dad3fe529e087dd8ae55fd4449959.jpg',
'https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_bb3738ed7df67b2b1d018e458d3ee5f9.jpg',
'https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_b9cc9355813dc2d671e647e63fe5fda8.jpg',
'https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_de2c54b2aad6b4febb84372470a2c810.jpg',
'https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_81f85157b295922532999ec6eccb8173.jpg',
'https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_7d697ab1d3018865eee5c5af1cdcf589.jpg',
'https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_42538b9f7d908bbb341ddc63af695e49.jpg',
'https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_b8ecd76e22209fb5802cc507c54ef59f.jpg',
'https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_df1b4290cf9e4852faa490fca7fe5821.jpg',
'https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_c2048119afffb420220d1c139a110b06.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a039315f-6826-5beb-ac21-2350b7aeae6e/a039315f-6826-5beb-ac21-2350b7aeae6e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86685,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_041dad3fe529e087dd8ae55fd4449959.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a039315f-6826-5beb-ac21-2350b7aeae6e/a039315f-6826-5beb-ac21-2350b7aeae6e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84623,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_bb3738ed7df67b2b1d018e458d3ee5f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a039315f-6826-5beb-ac21-2350b7aeae6e/a039315f-6826-5beb-ac21-2350b7aeae6e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79509,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_b9cc9355813dc2d671e647e63fe5fda8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a039315f-6826-5beb-ac21-2350b7aeae6e/a039315f-6826-5beb-ac21-2350b7aeae6e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_de2c54b2aad6b4febb84372470a2c810.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a039315f-6826-5beb-ac21-2350b7aeae6e/a039315f-6826-5beb-ac21-2350b7aeae6e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53110,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_81f85157b295922532999ec6eccb8173.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a039315f-6826-5beb-ac21-2350b7aeae6e/a039315f-6826-5beb-ac21-2350b7aeae6e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78063,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_7d697ab1d3018865eee5c5af1cdcf589.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a039315f-6826-5beb-ac21-2350b7aeae6e/a039315f-6826-5beb-ac21-2350b7aeae6e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47173,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_42538b9f7d908bbb341ddc63af695e49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a039315f-6826-5beb-ac21-2350b7aeae6e/a039315f-6826-5beb-ac21-2350b7aeae6e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83310,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_b8ecd76e22209fb5802cc507c54ef59f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a039315f-6826-5beb-ac21-2350b7aeae6e/a039315f-6826-5beb-ac21-2350b7aeae6e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70223,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_df1b4290cf9e4852faa490fca7fe5821.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a039315f-6826-5beb-ac21-2350b7aeae6e/a039315f-6826-5beb-ac21-2350b7aeae6e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70215,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/34/0234d852408a9686b9a9286c56b0e0fa/pa/PY98810_c2048119afffb420220d1c139a110b06.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-19',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Grand Scenic 1.6 dCi Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2018}
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY98810%27 HTTP/1.1" 200 None
2026-03-30 11:10:49 [auto1.fr] INFO: Saving data for PY98810: {'created_time': 1774869049.737938, 'last_price_update_time': 1774869049.737951, 'auction_closing_time': 1774970316.0}
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PY98810') HTTP/1.1" 204 0
2026-03-30 11:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WZ42856> (referer: https://www.auto1.com/v1/car-details-view/WZ42856/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09a94f3a-4141-50ea-a798-f421a68d9446 with identifier: WZ42856
2026-03-30 11:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09a94f3a-4141-50ea-a798-f421a68d9446 with scrape type 1
2026-03-30 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 09a94f3a-4141-50ea-a798-f421a68d9446
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F2a%252F432ad39f107a636f56fee8ce16cdc31a%252Fpa%252FWZ42856_330f6749fd0c966cf883442d1617f6e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_330f6749fd0c966cf883442d1617f6e1.jpg not downloaded yet
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F2a%252F432ad39f107a636f56fee8ce16cdc31a%252Fpa%252FWZ42856_760f42769b9b4e9598319a9be8a84300.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_760f42769b9b4e9598319a9be8a84300.jpg not downloaded yet
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F2a%252F432ad39f107a636f56fee8ce16cdc31a%252Fpa%252FWZ42856_b541f6c11f462a9c80b82aeba3cbd787.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_b541f6c11f462a9c80b82aeba3cbd787.jpg not downloaded yet
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F2a%252F432ad39f107a636f56fee8ce16cdc31a%252Fpa%252FWZ42856_5914a6b02353a5f01f532c32bd03be8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_5914a6b02353a5f01f532c32bd03be8e.jpg not downloaded yet
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F2a%252F432ad39f107a636f56fee8ce16cdc31a%252Fpa%252FWZ42856_bd06ceb7f55fe747e4917f2254f9cd37.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_bd06ceb7f55fe747e4917f2254f9cd37.jpg not downloaded yet
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F2a%252F432ad39f107a636f56fee8ce16cdc31a%252Fpa%252FWZ42856_a0d75aea70d33d705ea4e79dae462126.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_a0d75aea70d33d705ea4e79dae462126.jpg not downloaded yet
2026-03-30 11:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_330f6749fd0c966cf883442d1617f6e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_b541f6c11f462a9c80b82aeba3cbd787.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_5914a6b02353a5f01f532c32bd03be8e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_760f42769b9b4e9598319a9be8a84300.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384e7cd0>
2026-03-30 11:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a94f3a-4141-50ea-a798-f421a68d9446/09a94f3a-4141-50ea-a798-f421a68d9446_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F2a%252F432ad39f107a636f56fee8ce16cdc31a%252Fpa%252FWZ42856_330f6749fd0c966cf883442d1617f6e1.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_330f6749fd0c966cf883442d1617f6e1.jpg saved to cache
2026-03-30 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09a94f3a-4141-50ea-a798-f421a68d9446
2026-03-30 11:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_a0d75aea70d33d705ea4e79dae462126.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073841ba10>
2026-03-30 11:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a94f3a-4141-50ea-a798-f421a68d9446/09a94f3a-4141-50ea-a798-f421a68d9446_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F2a%252F432ad39f107a636f56fee8ce16cdc31a%252Fpa%252FWZ42856_b541f6c11f462a9c80b82aeba3cbd787.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_b541f6c11f462a9c80b82aeba3cbd787.jpg saved to cache
2026-03-30 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09a94f3a-4141-50ea-a798-f421a68d9446
2026-03-30 11:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738711450>
2026-03-30 11:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a94f3a-4141-50ea-a798-f421a68d9446/09a94f3a-4141-50ea-a798-f421a68d9446_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F2a%252F432ad39f107a636f56fee8ce16cdc31a%252Fpa%252FWZ42856_5914a6b02353a5f01f532c32bd03be8e.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_5914a6b02353a5f01f532c32bd03be8e.jpg saved to cache
2026-03-30 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09a94f3a-4141-50ea-a798-f421a68d9446
2026-03-30 11:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_bd06ceb7f55fe747e4917f2254f9cd37.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07387102d0>
2026-03-30 11:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a94f3a-4141-50ea-a798-f421a68d9446/09a94f3a-4141-50ea-a798-f421a68d9446_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F2a%252F432ad39f107a636f56fee8ce16cdc31a%252Fpa%252FWZ42856_760f42769b9b4e9598319a9be8a84300.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_760f42769b9b4e9598319a9be8a84300.jpg saved to cache
2026-03-30 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09a94f3a-4141-50ea-a798-f421a68d9446
2026-03-30 11:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384b3a10>
2026-03-30 11:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a94f3a-4141-50ea-a798-f421a68d9446/09a94f3a-4141-50ea-a798-f421a68d9446_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F2a%252F432ad39f107a636f56fee8ce16cdc31a%252Fpa%252FWZ42856_a0d75aea70d33d705ea4e79dae462126.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_a0d75aea70d33d705ea4e79dae462126.jpg saved to cache
2026-03-30 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09a94f3a-4141-50ea-a798-f421a68d9446
2026-03-30 11:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383d01d0>
2026-03-30 11:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a94f3a-4141-50ea-a798-f421a68d9446/09a94f3a-4141-50ea-a798-f421a68d9446_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F2a%252F432ad39f107a636f56fee8ce16cdc31a%252Fpa%252FWZ42856_bd06ceb7f55fe747e4917f2254f9cd37.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_bd06ceb7f55fe747e4917f2254f9cd37.jpg saved to cache
2026-03-30 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09a94f3a-4141-50ea-a798-f421a68d9446
2026-03-30 11:11:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09a94f3a-4141-50ea-a798-f421a68d9446, skipping ID generation
2026-03-30 11:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09a94f3a-4141-50ea-a798-f421a68d9446 with scrape type 1
2026-03-30 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09a94f3a-4141-50ea-a798-f421a68d9446 sending to next pipeline
2026-03-30 11:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 09a94f3a-4141-50ea-a798-f421a68d9446, identifier: WZ42856
2026-03-30 11:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 09a94f3a-4141-50ea-a798-f421a68d9446 with identifier: WZ42856
2026-03-30 11:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 09a94f3a-4141-50ea-a798-f421a68d9446 with identifier: WZ42856
2026-03-30 11:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 09a94f3a-4141-50ea-a798-f421a68d9446 with identifier: WZ42856 to the API
2026-03-30 11:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_bd06ceb7f55fe747e4917f2254f9cd37.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:41:41Z',
'fuel_type': 'petrol',
'id': '09a94f3a-4141-50ea-a798-f421a68d9446',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ42856',
'listing': 'auction',
'location': 'FR, Anthy-sur-Léman',
'make': 'Fiat',
'model': '500',
'odometer': 184403,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a94f3a-4141-50ea-a798-f421a68d9446/09a94f3a-4141-50ea-a798-f421a68d9446_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90056,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_330f6749fd0c966cf883442d1617f6e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a94f3a-4141-50ea-a798-f421a68d9446/09a94f3a-4141-50ea-a798-f421a68d9446_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90527,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_760f42769b9b4e9598319a9be8a84300.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a94f3a-4141-50ea-a798-f421a68d9446/09a94f3a-4141-50ea-a798-f421a68d9446_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61558,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_b541f6c11f462a9c80b82aeba3cbd787.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a94f3a-4141-50ea-a798-f421a68d9446/09a94f3a-4141-50ea-a798-f421a68d9446_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60505,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_5914a6b02353a5f01f532c32bd03be8e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a94f3a-4141-50ea-a798-f421a68d9446/09a94f3a-4141-50ea-a798-f421a68d9446_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_bd06ceb7f55fe747e4917f2254f9cd37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a94f3a-4141-50ea-a798-f421a68d9446/09a94f3a-4141-50ea-a798-f421a68d9446_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43257,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/2a/432ad39f107a636f56fee8ce16cdc31a/pa/WZ42856_a0d75aea70d33d705ea4e79dae462126.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-03-01',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.2 Pop',
'transmission': 'manual',
'trim': 'Pop',
'year': 2012}
2026-03-30 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ42856%27 HTTP/1.1" 200 None
2026-03-30 11:11:05 [auto1.fr] INFO: Saving data for WZ42856: {'created_time': 1774869065.541323, 'last_price_update_time': 1774869065.541333, 'auction_closing_time': 1774971701.0}
2026-03-30 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WZ42856') HTTP/1.1" 204 0
2026-03-30 11:11:05 [scrapy.extensions.logstats] INFO: Crawled 36 pages (at 6 pages/min), scraped 29 items (at 5 items/min)
2026-03-30 11:11:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-30 11:11:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.886(s), this was the 1st time calling it.
2026-03-30 11:11:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.148609874849691 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:11:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.062(s), this was the 1st time calling it.
2026-03-30 11:11:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.102803119436759 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:11:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.707(s), this was the 1st time calling it.
2026-03-30 11:11:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.712549268574752 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:11:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.708(s), this was the 1st time calling it.
2026-03-30 11:11:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.515370872101732 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:11:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:11:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC91432/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:11:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:11:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:11:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY14685/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.691(s), this was the 1st time calling it.
2026-03-30 11:12:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.075743209103738 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:03 [auto1.fr] INFO: Channel: 24h | Page: 4 | totalHits: 5545 | hits on page: 40
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: VE80756
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: GL02133
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: VX49143
2026-03-30 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX49143%27 HTTP/1.1" 200 None
2026-03-30 11:12:03 [auto1.fr] INFO: Scrape type for VX49143: 0
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: FK23512
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: XC31487
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: JN15401
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: CX38977
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: SV36178
2026-03-30 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV36178%27 HTTP/1.1" 200 None
2026-03-30 11:12:03 [auto1.fr] INFO: Scrape type for SV36178: 0
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: DS08848
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: TA72470
2026-03-30 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA72470%27 HTTP/1.1" 200 None
2026-03-30 11:12:03 [auto1.fr] INFO: Scrape type for TA72470: 0
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: VV44439
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: BH32555
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: GP66779
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: CY28334
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: LU64065
2026-03-30 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LU64065%27 HTTP/1.1" 200 None
2026-03-30 11:12:03 [auto1.fr] INFO: Scrape type for LU64065: 0
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: TJ82128
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: WN55034
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: KD15134
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: PU79516
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: CW34956
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: JX23289
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: ZS17982
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: CZ48020
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: CJ41818
2026-03-30 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ41818%27 HTTP/1.1" 200 None
2026-03-30 11:12:03 [auto1.fr] INFO: Scrape type for CJ41818: 1
2026-03-30 11:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: LM46920
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: UA34003
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: TV16458
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: BZ85729
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: PK34456
2026-03-30 11:12:03 [auto1.fr] INFO: Found listing with ID: RR47118
2026-03-30 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR47118%27 HTTP/1.1" 200 None
2026-03-30 11:12:03 [auto1.fr] INFO: Scrape type for RR47118: 2
2026-03-30 11:12:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f49acc46-061e-550c-8da7-0e4a5d7b4c64 with identifier: RR47118
2026-03-30 11:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f49acc46-061e-550c-8da7-0e4a5d7b4c64 with scrape type 2
2026-03-30 11:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f49acc46-061e-550c-8da7-0e4a5d7b4c64 with scrape type 2
2026-03-30 11:12:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f49acc46-061e-550c-8da7-0e4a5d7b4c64, identifier: RR47118
2026-03-30 11:12:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f49acc46-061e-550c-8da7-0e4a5d7b4c64 with identifier: RR47118
2026-03-30 11:12:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f49acc46-061e-550c-8da7-0e4a5d7b4c64 with identifier: RR47118
2026-03-30 11:12:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f49acc46-061e-550c-8da7-0e4a5d7b4c64 with identifier: RR47118 to the API
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:03:00Z',
'fuel_type': 'diesel',
'id': 'f49acc46-061e-550c-8da7-0e4a5d7b4c64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR47118',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 182739,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-06',
'seller_name': None,
'title': 'Renault Scenic 1.6 dCi Exception',
'transmission': 'manual',
'trim': 'Exception',
'year': 2011}
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR47118%27 HTTP/1.1" 200 None
2026-03-30 11:12:04 [auto1.fr] INFO: Saving data for RR47118: {'auction_closing_time': 1774969380.0, 'created_time': 1774365215.739563, 'last_price_update_time': 1774869124.277054}
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RR47118') HTTP/1.1" 204 0
2026-03-30 11:12:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:04 [auto1.fr] INFO: Found listing with ID: ZD92785
2026-03-30 11:12:04 [auto1.fr] INFO: Found listing with ID: MB27463
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB27463%27 HTTP/1.1" 200 None
2026-03-30 11:12:04 [auto1.fr] INFO: Scrape type for MB27463: 1
2026-03-30 11:12:04 [auto1.fr] INFO: Found listing with ID: ZD67967
2026-03-30 11:12:04 [auto1.fr] INFO: Found listing with ID: YP72685
2026-03-30 11:12:04 [auto1.fr] INFO: Found listing with ID: MR68962
2026-03-30 11:12:04 [auto1.fr] INFO: Found listing with ID: GH19552
2026-03-30 11:12:04 [auto1.fr] INFO: Found listing with ID: DS36987
2026-03-30 11:12:04 [auto1.fr] INFO: Found listing with ID: AL67797
2026-03-30 11:12:04 [auto1.fr] INFO: Found listing with ID: BV40330
2026-03-30 11:12:04 [auto1.fr] INFO: Found listing with ID: LW97985
2026-03-30 11:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC91432> (referer: https://www.auto1.com/v1/car-details-view/CC91432/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9317b54-f4eb-52da-888a-39821f84824e with identifier: CC91432
2026-03-30 11:12:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9317b54-f4eb-52da-888a-39821f84824e with scrape type 1
2026-03-30 11:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9317b54-f4eb-52da-888a-39821f84824e
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7d%252F1b7da6f1c6ed2fe7683793b18452693b%252Fpa%252FCC91432_c354f0dbf27964a53922e697ff9991a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_c354f0dbf27964a53922e697ff9991a5.jpg not downloaded yet
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7d%252F1b7da6f1c6ed2fe7683793b18452693b%252Fpa%252FCC91432_615299ffbf4d81b83895fa74a8101d95.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_615299ffbf4d81b83895fa74a8101d95.jpg not downloaded yet
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7d%252F1b7da6f1c6ed2fe7683793b18452693b%252Fpa%252FCC91432_4004e174dd85192d1c6caca81bab9e2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_4004e174dd85192d1c6caca81bab9e2f.jpg not downloaded yet
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7d%252F1b7da6f1c6ed2fe7683793b18452693b%252Fpa%252FCC91432_3bc453bac8a117b0c5e3d2a746f0dab1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_3bc453bac8a117b0c5e3d2a746f0dab1.jpg not downloaded yet
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7d%252F1b7da6f1c6ed2fe7683793b18452693b%252Fpa%252FCC91432_7a6ad0908ca7abc7bf65fb527addbec0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_7a6ad0908ca7abc7bf65fb527addbec0.jpg not downloaded yet
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7d%252F1b7da6f1c6ed2fe7683793b18452693b%252Fpa%252FCC91432_11ab8e95bcaee3706cca849be8b20e4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_11ab8e95bcaee3706cca849be8b20e4a.jpg not downloaded yet
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7d%252F1b7da6f1c6ed2fe7683793b18452693b%252Fpa%252FCC91432_04766769b27933944a5a4ddec98c7b70.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_04766769b27933944a5a4ddec98c7b70.jpg not downloaded yet
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7d%252F1b7da6f1c6ed2fe7683793b18452693b%252Fpa%252FCC91432_d5a9349f67cda39dd601778ce8c1f2b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_d5a9349f67cda39dd601778ce8c1f2b1.jpg not downloaded yet
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7d%252F1b7da6f1c6ed2fe7683793b18452693b%252Fpa%252FCC91432_dfe6088e874fc17815777741483a58a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_dfe6088e874fc17815777741483a58a8.jpg not downloaded yet
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7d%252F1b7da6f1c6ed2fe7683793b18452693b%252Fpa%252FCC91432_f7f6a0d2992c9715c3697ccdf6f9cc88.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_f7f6a0d2992c9715c3697ccdf6f9cc88.jpg not downloaded yet
2026-03-30 11:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_c354f0dbf27964a53922e697ff9991a5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_4004e174dd85192d1c6caca81bab9e2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_11ab8e95bcaee3706cca849be8b20e4a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_d5a9349f67cda39dd601778ce8c1f2b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_7a6ad0908ca7abc7bf65fb527addbec0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_3bc453bac8a117b0c5e3d2a746f0dab1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_dfe6088e874fc17815777741483a58a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_f7f6a0d2992c9715c3697ccdf6f9cc88.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738439a90>
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9317b54-f4eb-52da-888a-39821f84824e/e9317b54-f4eb-52da-888a-39821f84824e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7d%252F1b7da6f1c6ed2fe7683793b18452693b%252Fpa%252FCC91432_c354f0dbf27964a53922e697ff9991a5.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_c354f0dbf27964a53922e697ff9991a5.jpg saved to cache
2026-03-30 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9317b54-f4eb-52da-888a-39821f84824e
2026-03-30 11:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_04766769b27933944a5a4ddec98c7b70.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:05 [scrapy.extensions.logstats] INFO: Crawled 48 pages (at 12 pages/min), scraped 30 items (at 1 items/min)
2026-03-30 11:12:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_615299ffbf4d81b83895fa74a8101d95.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384d5b10>
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9317b54-f4eb-52da-888a-39821f84824e/e9317b54-f4eb-52da-888a-39821f84824e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7d%252F1b7da6f1c6ed2fe7683793b18452693b%252Fpa%252FCC91432_4004e174dd85192d1c6caca81bab9e2f.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_4004e174dd85192d1c6caca81bab9e2f.jpg saved to cache
2026-03-30 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9317b54-f4eb-52da-888a-39821f84824e
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384d7dd0>
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9317b54-f4eb-52da-888a-39821f84824e/e9317b54-f4eb-52da-888a-39821f84824e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7d%252F1b7da6f1c6ed2fe7683793b18452693b%252Fpa%252FCC91432_11ab8e95bcaee3706cca849be8b20e4a.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_11ab8e95bcaee3706cca849be8b20e4a.jpg saved to cache
2026-03-30 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9317b54-f4eb-52da-888a-39821f84824e
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073845e910>
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9317b54-f4eb-52da-888a-39821f84824e/e9317b54-f4eb-52da-888a-39821f84824e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7d%252F1b7da6f1c6ed2fe7683793b18452693b%252Fpa%252FCC91432_d5a9349f67cda39dd601778ce8c1f2b1.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_d5a9349f67cda39dd601778ce8c1f2b1.jpg saved to cache
2026-03-30 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9317b54-f4eb-52da-888a-39821f84824e
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384d0350>
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9317b54-f4eb-52da-888a-39821f84824e/e9317b54-f4eb-52da-888a-39821f84824e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7d%252F1b7da6f1c6ed2fe7683793b18452693b%252Fpa%252FCC91432_7a6ad0908ca7abc7bf65fb527addbec0.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_7a6ad0908ca7abc7bf65fb527addbec0.jpg saved to cache
2026-03-30 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9317b54-f4eb-52da-888a-39821f84824e
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383f4110>
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9317b54-f4eb-52da-888a-39821f84824e/e9317b54-f4eb-52da-888a-39821f84824e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7d%252F1b7da6f1c6ed2fe7683793b18452693b%252Fpa%252FCC91432_3bc453bac8a117b0c5e3d2a746f0dab1.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_3bc453bac8a117b0c5e3d2a746f0dab1.jpg saved to cache
2026-03-30 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9317b54-f4eb-52da-888a-39821f84824e
2026-03-30 11:12:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738487290>
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9317b54-f4eb-52da-888a-39821f84824e/e9317b54-f4eb-52da-888a-39821f84824e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7d%252F1b7da6f1c6ed2fe7683793b18452693b%252Fpa%252FCC91432_dfe6088e874fc17815777741483a58a8.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_dfe6088e874fc17815777741483a58a8.jpg saved to cache
2026-03-30 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e9317b54-f4eb-52da-888a-39821f84824e
2026-03-30 11:12:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383f62d0>
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9317b54-f4eb-52da-888a-39821f84824e/e9317b54-f4eb-52da-888a-39821f84824e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7d%252F1b7da6f1c6ed2fe7683793b18452693b%252Fpa%252FCC91432_f7f6a0d2992c9715c3697ccdf6f9cc88.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_f7f6a0d2992c9715c3697ccdf6f9cc88.jpg saved to cache
2026-03-30 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e9317b54-f4eb-52da-888a-39821f84824e
2026-03-30 11:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CJ41818/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385fd690>
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9317b54-f4eb-52da-888a-39821f84824e/e9317b54-f4eb-52da-888a-39821f84824e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7d%252F1b7da6f1c6ed2fe7683793b18452693b%252Fpa%252FCC91432_04766769b27933944a5a4ddec98c7b70.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_04766769b27933944a5a4ddec98c7b70.jpg saved to cache
2026-03-30 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9317b54-f4eb-52da-888a-39821f84824e
2026-03-30 11:12:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073853c710>
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9317b54-f4eb-52da-888a-39821f84824e/e9317b54-f4eb-52da-888a-39821f84824e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7d%252F1b7da6f1c6ed2fe7683793b18452693b%252Fpa%252FCC91432_615299ffbf4d81b83895fa74a8101d95.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_615299ffbf4d81b83895fa74a8101d95.jpg saved to cache
2026-03-30 11:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9317b54-f4eb-52da-888a-39821f84824e
2026-03-30 11:12:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9317b54-f4eb-52da-888a-39821f84824e, skipping ID generation
2026-03-30 11:12:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9317b54-f4eb-52da-888a-39821f84824e with scrape type 1
2026-03-30 11:12:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9317b54-f4eb-52da-888a-39821f84824e sending to next pipeline
2026-03-30 11:12:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e9317b54-f4eb-52da-888a-39821f84824e, identifier: CC91432
2026-03-30 11:12:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e9317b54-f4eb-52da-888a-39821f84824e with identifier: CC91432
2026-03-30 11:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:12:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 11:12:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:12:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e9317b54-f4eb-52da-888a-39821f84824e with identifier: CC91432
2026-03-30 11:12:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e9317b54-f4eb-52da-888a-39821f84824e with identifier: CC91432 to the API
2026-03-30 11:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_615299ffbf4d81b83895fa74a8101d95.jpg>
{'auction_title': '',
'c_o_2_emission_value': 90,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.8L',
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:49:37Z',
'fuel_type': 'hybrid',
'id': 'e9317b54-f4eb-52da-888a-39821f84824e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC91432',
'listing': 'auction',
'location': 'FR, Nice',
'make': 'Toyota',
'model': 'Auris',
'odometer': 121316,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9317b54-f4eb-52da-888a-39821f84824e/e9317b54-f4eb-52da-888a-39821f84824e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3179987,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_c354f0dbf27964a53922e697ff9991a5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9317b54-f4eb-52da-888a-39821f84824e/e9317b54-f4eb-52da-888a-39821f84824e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3038269,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_615299ffbf4d81b83895fa74a8101d95.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9317b54-f4eb-52da-888a-39821f84824e/e9317b54-f4eb-52da-888a-39821f84824e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2786503,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_4004e174dd85192d1c6caca81bab9e2f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9317b54-f4eb-52da-888a-39821f84824e/e9317b54-f4eb-52da-888a-39821f84824e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_3bc453bac8a117b0c5e3d2a746f0dab1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9317b54-f4eb-52da-888a-39821f84824e/e9317b54-f4eb-52da-888a-39821f84824e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72268,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_7a6ad0908ca7abc7bf65fb527addbec0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9317b54-f4eb-52da-888a-39821f84824e/e9317b54-f4eb-52da-888a-39821f84824e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82537,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_11ab8e95bcaee3706cca849be8b20e4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9317b54-f4eb-52da-888a-39821f84824e/e9317b54-f4eb-52da-888a-39821f84824e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60177,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_04766769b27933944a5a4ddec98c7b70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9317b54-f4eb-52da-888a-39821f84824e/e9317b54-f4eb-52da-888a-39821f84824e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_d5a9349f67cda39dd601778ce8c1f2b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9317b54-f4eb-52da-888a-39821f84824e/e9317b54-f4eb-52da-888a-39821f84824e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3048870,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_dfe6088e874fc17815777741483a58a8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9317b54-f4eb-52da-888a-39821f84824e/e9317b54-f4eb-52da-888a-39821f84824e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2728271,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1b/7d/1b7da6f1c6ed2fe7683793b18452693b/pa/CC91432_f7f6a0d2992c9715c3697ccdf6f9cc88.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-12-23',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Auris 1.8 Hybrid Collection',
'transmission': 'automatic',
'trim': 'Collection',
'year': 2018}
2026-03-30 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC91432%27 HTTP/1.1" 200 None
2026-03-30 11:12:06 [auto1.fr] INFO: Saving data for CC91432: {'created_time': 1774869126.720541, 'last_price_update_time': 1774869126.72055, 'auction_closing_time': 1774972177.0}
2026-03-30 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CC91432') HTTP/1.1" 204 0
2026-03-30 11:12:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NS29326/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NS29326> (referer: https://www.auto1.com/v1/car-details-view/NS29326/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be6418ec-b8a4-5588-8b1f-8fbfda8d9204 with identifier: NS29326
2026-03-30 11:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be6418ec-b8a4-5588-8b1f-8fbfda8d9204 with scrape type 1
2026-03-30 11:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be6418ec-b8a4-5588-8b1f-8fbfda8d9204
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F1a%252Fc41a4c1396b63fce44fa94e39ffcb022%252Fpa%252FNS29326_ab46fdcda44dd0e29a514c2dae4a5007.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_ab46fdcda44dd0e29a514c2dae4a5007.jpg already downloaded
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F1a%252Fc41a4c1396b63fce44fa94e39ffcb022%252Fpa%252FNS29326_a5c1baa61eb487c917bd59d652544c0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_a5c1baa61eb487c917bd59d652544c0a.jpg already downloaded
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F1a%252Fc41a4c1396b63fce44fa94e39ffcb022%252Fpa%252FNS29326_f0376673ddf1793f0c4dd4e169519f8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_f0376673ddf1793f0c4dd4e169519f8e.jpg already downloaded
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F1a%252Fc41a4c1396b63fce44fa94e39ffcb022%252Fpa%252FNS29326_d4cf72cc1bf32850392492bb6b05de66.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_d4cf72cc1bf32850392492bb6b05de66.jpg already downloaded
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F1a%252Fc41a4c1396b63fce44fa94e39ffcb022%252Fpa%252FNS29326_7a43f2a32b48b6eee18186ab27e542cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_7a43f2a32b48b6eee18186ab27e542cd.jpg already downloaded
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F1a%252Fc41a4c1396b63fce44fa94e39ffcb022%252Fpa%252FNS29326_8c199bca16e8a23514da213df9f148f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_8c199bca16e8a23514da213df9f148f8.jpg already downloaded
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F1a%252Fc41a4c1396b63fce44fa94e39ffcb022%252Fpa%252FNS29326_5b337a08d4d4f5e3eff07351cd7445d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_5b337a08d4d4f5e3eff07351cd7445d7.jpg already downloaded
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F1a%252Fc41a4c1396b63fce44fa94e39ffcb022%252Fpa%252FNS29326_0a7f238cd85a8409b504839f814e940f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_0a7f238cd85a8409b504839f814e940f.jpg already downloaded
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F1a%252Fc41a4c1396b63fce44fa94e39ffcb022%252Fpa%252FNS29326_9dcf6760868114e5cdf654a1b0dd80e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_9dcf6760868114e5cdf654a1b0dd80e9.jpg already downloaded
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F1a%252Fc41a4c1396b63fce44fa94e39ffcb022%252Fpa%252FNS29326_f79416fedd09e61ecd222892d4ae9605.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_f79416fedd09e61ecd222892d4ae9605.jpg already downloaded
2026-03-30 11:12:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: be6418ec-b8a4-5588-8b1f-8fbfda8d9204, identifier: NS29326
2026-03-30 11:12:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: be6418ec-b8a4-5588-8b1f-8fbfda8d9204 with identifier: NS29326
2026-03-30 11:12:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: be6418ec-b8a4-5588-8b1f-8fbfda8d9204 with identifier: NS29326
2026-03-30 11:12:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: be6418ec-b8a4-5588-8b1f-8fbfda8d9204 with identifier: NS29326 to the API
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NS29326>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:43:26Z',
'fuel_type': 'petrol',
'id': 'be6418ec-b8a4-5588-8b1f-8fbfda8d9204',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS29326',
'listing': 'auction',
'location': 'FR, Tradein',
'make': 'Peugeot',
'model': '208',
'odometer': 98450,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_ab46fdcda44dd0e29a514c2dae4a5007.jpg',
'https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_a5c1baa61eb487c917bd59d652544c0a.jpg',
'https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_f0376673ddf1793f0c4dd4e169519f8e.jpg',
'https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_d4cf72cc1bf32850392492bb6b05de66.jpg',
'https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_7a43f2a32b48b6eee18186ab27e542cd.jpg',
'https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_8c199bca16e8a23514da213df9f148f8.jpg',
'https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_5b337a08d4d4f5e3eff07351cd7445d7.jpg',
'https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_0a7f238cd85a8409b504839f814e940f.jpg',
'https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_9dcf6760868114e5cdf654a1b0dd80e9.jpg',
'https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_f79416fedd09e61ecd222892d4ae9605.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be6418ec-b8a4-5588-8b1f-8fbfda8d9204/be6418ec-b8a4-5588-8b1f-8fbfda8d9204_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 129954,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_ab46fdcda44dd0e29a514c2dae4a5007.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be6418ec-b8a4-5588-8b1f-8fbfda8d9204/be6418ec-b8a4-5588-8b1f-8fbfda8d9204_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 129148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_a5c1baa61eb487c917bd59d652544c0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be6418ec-b8a4-5588-8b1f-8fbfda8d9204/be6418ec-b8a4-5588-8b1f-8fbfda8d9204_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 129755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_f0376673ddf1793f0c4dd4e169519f8e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be6418ec-b8a4-5588-8b1f-8fbfda8d9204/be6418ec-b8a4-5588-8b1f-8fbfda8d9204_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110461,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_d4cf72cc1bf32850392492bb6b05de66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be6418ec-b8a4-5588-8b1f-8fbfda8d9204/be6418ec-b8a4-5588-8b1f-8fbfda8d9204_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1801594,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_7a43f2a32b48b6eee18186ab27e542cd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be6418ec-b8a4-5588-8b1f-8fbfda8d9204/be6418ec-b8a4-5588-8b1f-8fbfda8d9204_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134541,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_8c199bca16e8a23514da213df9f148f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be6418ec-b8a4-5588-8b1f-8fbfda8d9204/be6418ec-b8a4-5588-8b1f-8fbfda8d9204_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116572,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_5b337a08d4d4f5e3eff07351cd7445d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be6418ec-b8a4-5588-8b1f-8fbfda8d9204/be6418ec-b8a4-5588-8b1f-8fbfda8d9204_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_0a7f238cd85a8409b504839f814e940f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be6418ec-b8a4-5588-8b1f-8fbfda8d9204/be6418ec-b8a4-5588-8b1f-8fbfda8d9204_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1662867,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_9dcf6760868114e5cdf654a1b0dd80e9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be6418ec-b8a4-5588-8b1f-8fbfda8d9204/be6418ec-b8a4-5588-8b1f-8fbfda8d9204_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89780,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/1a/c41a4c1396b63fce44fa94e39ffcb022/pa/NS29326_f79416fedd09e61ecd222892d4ae9605.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-11-09',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 e-THP GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2016}
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS29326%27 HTTP/1.1" 200 None
2026-03-30 11:12:16 [auto1.fr] INFO: Saving data for NS29326: {'created_time': 1774869136.061075, 'last_price_update_time': 1774869136.061085, 'auction_closing_time': 1774971806.0}
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NS29326') HTTP/1.1" 204 0
2026-03-30 11:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB27463/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CJ41818> (referer: https://www.auto1.com/v1/car-details-view/CJ41818/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b1de298-8822-590a-862e-346ed7094323 with identifier: CJ41818
2026-03-30 11:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b1de298-8822-590a-862e-346ed7094323 with scrape type 1
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2b1de298-8822-590a-862e-346ed7094323
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe9%252F1de9a48471cbaa088272b731c4f88386%252Fpa%252FCJ41818_278a9de6f5acb27fe9957335d8dbb836.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_278a9de6f5acb27fe9957335d8dbb836.jpg not downloaded yet
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe9%252F1de9a48471cbaa088272b731c4f88386%252Fpa%252FCJ41818_1e5465903666b8c914832735b33e5e28.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_1e5465903666b8c914832735b33e5e28.jpg not downloaded yet
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe9%252F1de9a48471cbaa088272b731c4f88386%252Fpa%252FCJ41818_fa399971084c82629954f31d9a5f5eed.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_fa399971084c82629954f31d9a5f5eed.jpg not downloaded yet
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe9%252F1de9a48471cbaa088272b731c4f88386%252Fpa%252FCJ41818_d525b476de1d112baae135567ce1ca7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_d525b476de1d112baae135567ce1ca7b.jpg not downloaded yet
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe9%252F1de9a48471cbaa088272b731c4f88386%252Fpa%252FCJ41818_57649a79f72a113e367347d381813141.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_57649a79f72a113e367347d381813141.jpg not downloaded yet
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe9%252F1de9a48471cbaa088272b731c4f88386%252Fpa%252FCJ41818_c87601c70d824cf7ce75b40ebe84c3b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_c87601c70d824cf7ce75b40ebe84c3b1.jpg not downloaded yet
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe9%252F1de9a48471cbaa088272b731c4f88386%252Fpa%252FCJ41818_4abd8d0644942ca36cd354195f9b67cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_4abd8d0644942ca36cd354195f9b67cf.jpg not downloaded yet
2026-03-30 11:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_1e5465903666b8c914832735b33e5e28.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe9%252F1de9a48471cbaa088272b731c4f88386%252Fpa%252FCJ41818_04b2c1f4ca163a525a5001d545271d47.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_04b2c1f4ca163a525a5001d545271d47.jpg not downloaded yet
2026-03-30 11:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_278a9de6f5acb27fe9957335d8dbb836.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe9%252F1de9a48471cbaa088272b731c4f88386%252Fpa%252FCJ41818_335c96bb2343b7a23c84cf7f137f9afe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_335c96bb2343b7a23c84cf7f137f9afe.jpg not downloaded yet
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe9%252F1de9a48471cbaa088272b731c4f88386%252Fpa%252FCJ41818_ce11f3df25aed6cfbfec376f44c42885.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_ce11f3df25aed6cfbfec376f44c42885.jpg not downloaded yet
2026-03-30 11:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_fa399971084c82629954f31d9a5f5eed.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07393e8dd0>
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1de298-8822-590a-862e-346ed7094323/2b1de298-8822-590a-862e-346ed7094323_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe9%252F1de9a48471cbaa088272b731c4f88386%252Fpa%252FCJ41818_1e5465903666b8c914832735b33e5e28.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_1e5465903666b8c914832735b33e5e28.jpg saved to cache
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b1de298-8822-590a-862e-346ed7094323
2026-03-30 11:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_04b2c1f4ca163a525a5001d545271d47.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_d525b476de1d112baae135567ce1ca7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_335c96bb2343b7a23c84cf7f137f9afe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_4abd8d0644942ca36cd354195f9b67cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_ce11f3df25aed6cfbfec376f44c42885.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384ebb10>
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1de298-8822-590a-862e-346ed7094323/2b1de298-8822-590a-862e-346ed7094323_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe9%252F1de9a48471cbaa088272b731c4f88386%252Fpa%252FCJ41818_278a9de6f5acb27fe9957335d8dbb836.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_278a9de6f5acb27fe9957335d8dbb836.jpg saved to cache
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b1de298-8822-590a-862e-346ed7094323
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073860d390>
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1de298-8822-590a-862e-346ed7094323/2b1de298-8822-590a-862e-346ed7094323_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe9%252F1de9a48471cbaa088272b731c4f88386%252Fpa%252FCJ41818_fa399971084c82629954f31d9a5f5eed.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_fa399971084c82629954f31d9a5f5eed.jpg saved to cache
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b1de298-8822-590a-862e-346ed7094323
2026-03-30 11:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX79018> (referer: https://www.auto1.com/v1/car-details-view/KX79018/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384ebb10>
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1de298-8822-590a-862e-346ed7094323/2b1de298-8822-590a-862e-346ed7094323_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe9%252F1de9a48471cbaa088272b731c4f88386%252Fpa%252FCJ41818_04b2c1f4ca163a525a5001d545271d47.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_04b2c1f4ca163a525a5001d545271d47.jpg saved to cache
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2b1de298-8822-590a-862e-346ed7094323
2026-03-30 11:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_57649a79f72a113e367347d381813141.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385d79d0>
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1de298-8822-590a-862e-346ed7094323/2b1de298-8822-590a-862e-346ed7094323_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe9%252F1de9a48471cbaa088272b731c4f88386%252Fpa%252FCJ41818_d525b476de1d112baae135567ce1ca7b.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_d525b476de1d112baae135567ce1ca7b.jpg saved to cache
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b1de298-8822-590a-862e-346ed7094323
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383ff610>
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1de298-8822-590a-862e-346ed7094323/2b1de298-8822-590a-862e-346ed7094323_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe9%252F1de9a48471cbaa088272b731c4f88386%252Fpa%252FCJ41818_335c96bb2343b7a23c84cf7f137f9afe.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_335c96bb2343b7a23c84cf7f137f9afe.jpg saved to cache
2026-03-30 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2b1de298-8822-590a-862e-346ed7094323
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384bfcd0>
2026-03-30 11:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1de298-8822-590a-862e-346ed7094323/2b1de298-8822-590a-862e-346ed7094323_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe9%252F1de9a48471cbaa088272b731c4f88386%252Fpa%252FCJ41818_4abd8d0644942ca36cd354195f9b67cf.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_4abd8d0644942ca36cd354195f9b67cf.jpg saved to cache
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2b1de298-8822-590a-862e-346ed7094323
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a4b2e90>
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1de298-8822-590a-862e-346ed7094323/2b1de298-8822-590a-862e-346ed7094323_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe9%252F1de9a48471cbaa088272b731c4f88386%252Fpa%252FCJ41818_ce11f3df25aed6cfbfec376f44c42885.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_ce11f3df25aed6cfbfec376f44c42885.jpg saved to cache
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2b1de298-8822-590a-862e-346ed7094323
2026-03-30 11:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_c87601c70d824cf7ce75b40ebe84c3b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a with identifier: KX79018
2026-03-30 11:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a with scrape type 1
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc786db67bad7245577e8c6eb95f5e5e8%252Fpa%252FKX79018_5094566c20798ff0f6ce3adb2b81799a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_5094566c20798ff0f6ce3adb2b81799a.jpg already downloaded
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc786db67bad7245577e8c6eb95f5e5e8%252Fpa%252FKX79018_54e151be836e2e41f9e2c43b3aed7d10.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_54e151be836e2e41f9e2c43b3aed7d10.jpg already downloaded
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc786db67bad7245577e8c6eb95f5e5e8%252Fpa%252FKX79018_50f9639c1b64af5c4176b06cb5b2f580.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_50f9639c1b64af5c4176b06cb5b2f580.jpg already downloaded
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc786db67bad7245577e8c6eb95f5e5e8%252Fpa%252FKX79018_6802052e55c50a760ba0478e4050f761.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_6802052e55c50a760ba0478e4050f761.jpg already downloaded
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc786db67bad7245577e8c6eb95f5e5e8%252Fpa%252FKX79018_49a4ecf042f3aae40268e1b3f85ee66c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_49a4ecf042f3aae40268e1b3f85ee66c.jpg already downloaded
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc786db67bad7245577e8c6eb95f5e5e8%252Fpa%252FKX79018_2c9d242d249d1a86d08fbc43ea78a7ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_2c9d242d249d1a86d08fbc43ea78a7ed.jpg already downloaded
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc786db67bad7245577e8c6eb95f5e5e8%252Fpa%252FKX79018_cc70978d4bb7cd7b54398b9268b1cf92.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_cc70978d4bb7cd7b54398b9268b1cf92.jpg already downloaded
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc786db67bad7245577e8c6eb95f5e5e8%252Fpa%252FKX79018_1b116e4c9deccd17971c392c322c9207.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_1b116e4c9deccd17971c392c322c9207.jpg already downloaded
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc786db67bad7245577e8c6eb95f5e5e8%252Fpa%252FKX79018_64bcff5ea66ed66af46b93fcead4b81e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_64bcff5ea66ed66af46b93fcead4b81e.jpg already downloaded
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc786db67bad7245577e8c6eb95f5e5e8%252Fpa%252FKX79018_74cc607f5d74e483271bbb1fd37b4b56.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_74cc607f5d74e483271bbb1fd37b4b56.jpg already downloaded
2026-03-30 11:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a, identifier: KX79018
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a4b3a10>
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1de298-8822-590a-862e-346ed7094323/2b1de298-8822-590a-862e-346ed7094323_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe9%252F1de9a48471cbaa088272b731c4f88386%252Fpa%252FCJ41818_57649a79f72a113e367347d381813141.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_57649a79f72a113e367347d381813141.jpg saved to cache
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b1de298-8822-590a-862e-346ed7094323
2026-03-30 11:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a with identifier: KX79018
2026-03-30 11:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a with identifier: KX79018
2026-03-30 11:12:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a with identifier: KX79018 to the API
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KX79018>
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:34:10Z',
'fuel_type': 'diesel',
'id': '9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX79018',
'listing': 'auction',
'location': 'FR, Villeneuve-lès-Béziers',
'make': 'Renault',
'model': 'Megane',
'odometer': 200806,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_5094566c20798ff0f6ce3adb2b81799a.jpg',
'https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_54e151be836e2e41f9e2c43b3aed7d10.jpg',
'https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_50f9639c1b64af5c4176b06cb5b2f580.jpg',
'https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_6802052e55c50a760ba0478e4050f761.jpg',
'https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_49a4ecf042f3aae40268e1b3f85ee66c.jpg',
'https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_2c9d242d249d1a86d08fbc43ea78a7ed.jpg',
'https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_cc70978d4bb7cd7b54398b9268b1cf92.jpg',
'https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_1b116e4c9deccd17971c392c322c9207.jpg',
'https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_64bcff5ea66ed66af46b93fcead4b81e.jpg',
'https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_74cc607f5d74e483271bbb1fd37b4b56.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a/9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_5094566c20798ff0f6ce3adb2b81799a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a/9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_54e151be836e2e41f9e2c43b3aed7d10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a/9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73080,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_50f9639c1b64af5c4176b06cb5b2f580.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a/9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_6802052e55c50a760ba0478e4050f761.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a/9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74004,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_49a4ecf042f3aae40268e1b3f85ee66c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a/9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2428747,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_2c9d242d249d1a86d08fbc43ea78a7ed.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a/9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2342694,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_cc70978d4bb7cd7b54398b9268b1cf92.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a/9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2362797,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_1b116e4c9deccd17971c392c322c9207.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a/9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75595,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_64bcff5ea66ed66af46b93fcead4b81e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a/9e4d3cd4-8f50-5eb7-b70c-74a2df8f176a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76557,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/86/c786db67bad7245577e8c6eb95f5e5e8/pa/KX79018_74cc607f5d74e483271bbb1fd37b4b56.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Energy Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2017}
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX79018%27 HTTP/1.1" 200 None
2026-03-30 11:12:20 [auto1.fr] INFO: Saving data for KX79018: {'created_time': 1774869140.848564, 'last_price_update_time': 1774869140.848576, 'auction_closing_time': 1774971250.0}
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KX79018') HTTP/1.1" 204 0
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073871fb90>
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1de298-8822-590a-862e-346ed7094323/2b1de298-8822-590a-862e-346ed7094323_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe9%252F1de9a48471cbaa088272b731c4f88386%252Fpa%252FCJ41818_c87601c70d824cf7ce75b40ebe84c3b1.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_c87601c70d824cf7ce75b40ebe84c3b1.jpg saved to cache
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2b1de298-8822-590a-862e-346ed7094323
2026-03-30 11:12:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b1de298-8822-590a-862e-346ed7094323, skipping ID generation
2026-03-30 11:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b1de298-8822-590a-862e-346ed7094323 with scrape type 1
2026-03-30 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b1de298-8822-590a-862e-346ed7094323 sending to next pipeline
2026-03-30 11:12:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2b1de298-8822-590a-862e-346ed7094323, identifier: CJ41818
2026-03-30 11:12:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2b1de298-8822-590a-862e-346ed7094323 with identifier: CJ41818
2026-03-30 11:12:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2b1de298-8822-590a-862e-346ed7094323 with identifier: CJ41818
2026-03-30 11:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2b1de298-8822-590a-862e-346ed7094323 with identifier: CJ41818 to the API
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_c87601c70d824cf7ce75b40ebe84c3b1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:52:06Z',
'fuel_type': 'diesel',
'id': '2b1de298-8822-590a-862e-346ed7094323',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ41818',
'listing': 'auction',
'location': 'FR',
'make': 'Peugeot',
'model': '3008',
'odometer': 162631,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1de298-8822-590a-862e-346ed7094323/2b1de298-8822-590a-862e-346ed7094323_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_278a9de6f5acb27fe9957335d8dbb836.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1de298-8822-590a-862e-346ed7094323/2b1de298-8822-590a-862e-346ed7094323_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109005,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_1e5465903666b8c914832735b33e5e28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1de298-8822-590a-862e-346ed7094323/2b1de298-8822-590a-862e-346ed7094323_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111445,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_fa399971084c82629954f31d9a5f5eed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1de298-8822-590a-862e-346ed7094323/2b1de298-8822-590a-862e-346ed7094323_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98177,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_d525b476de1d112baae135567ce1ca7b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1de298-8822-590a-862e-346ed7094323/2b1de298-8822-590a-862e-346ed7094323_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112369,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_57649a79f72a113e367347d381813141.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1de298-8822-590a-862e-346ed7094323/2b1de298-8822-590a-862e-346ed7094323_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136952,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_c87601c70d824cf7ce75b40ebe84c3b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1de298-8822-590a-862e-346ed7094323/2b1de298-8822-590a-862e-346ed7094323_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120562,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_4abd8d0644942ca36cd354195f9b67cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1de298-8822-590a-862e-346ed7094323/2b1de298-8822-590a-862e-346ed7094323_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88152,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_04b2c1f4ca163a525a5001d545271d47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1de298-8822-590a-862e-346ed7094323/2b1de298-8822-590a-862e-346ed7094323_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83656,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_335c96bb2343b7a23c84cf7f137f9afe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1de298-8822-590a-862e-346ed7094323/2b1de298-8822-590a-862e-346ed7094323_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69152,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/e9/1de9a48471cbaa088272b731c4f88386/pa/CJ41818_ce11f3df25aed6cfbfec376f44c42885.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-05-18',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 Blue-HDi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2015}
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ41818%27 HTTP/1.1" 200 None
2026-03-30 11:12:21 [auto1.fr] INFO: Saving data for CJ41818: {'created_time': 1774869141.367807, 'last_price_update_time': 1774869141.367819, 'auction_closing_time': 1774972326.0}
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CJ41818') HTTP/1.1" 204 0
2026-03-30 11:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY14685> (referer: https://www.auto1.com/v1/car-details-view/UY14685/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0cbaa82-6b18-5548-813b-4b87efe2c21e with identifier: UY14685
2026-03-30 11:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0cbaa82-6b18-5548-813b-4b87efe2c21e with scrape type 1
2026-03-30 11:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d0cbaa82-6b18-5548-813b-4b87efe2c21e
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F98%252F48987dc5727c88449c169f6e378150a1%252Fpa%252FUY14685_6fce5b6f4ee8f19ddea34c619b9f7371.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/98/48987dc5727c88449c169f6e378150a1/pa/UY14685_6fce5b6f4ee8f19ddea34c619b9f7371.jpg already downloaded
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F98%252F48987dc5727c88449c169f6e378150a1%252Fpa%252FUY14685_46bc8374deeee3a7dd3828e2fc3510bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/98/48987dc5727c88449c169f6e378150a1/pa/UY14685_46bc8374deeee3a7dd3828e2fc3510bf.jpg already downloaded
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F98%252F48987dc5727c88449c169f6e378150a1%252Fpa%252FUY14685_1b31b945927a394dcc6d605e00bf5b6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/98/48987dc5727c88449c169f6e378150a1/pa/UY14685_1b31b945927a394dcc6d605e00bf5b6f.jpg already downloaded
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F98%252F48987dc5727c88449c169f6e378150a1%252Fpa%252FUY14685_110cb154e9aaf566ff0a519a78101030.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/98/48987dc5727c88449c169f6e378150a1/pa/UY14685_110cb154e9aaf566ff0a519a78101030.jpg already downloaded
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F98%252F48987dc5727c88449c169f6e378150a1%252Fpa%252FUY14685_78f7646e9716d2cd2abdeaef510c7406.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/98/48987dc5727c88449c169f6e378150a1/pa/UY14685_78f7646e9716d2cd2abdeaef510c7406.jpg already downloaded
2026-03-30 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F98%252F48987dc5727c88449c169f6e378150a1%252Fpa%252FUY14685_45a4447f399c3b8a8236c1804e944254.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/98/48987dc5727c88449c169f6e378150a1/pa/UY14685_45a4447f399c3b8a8236c1804e944254.jpg already downloaded
2026-03-30 11:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d0cbaa82-6b18-5548-813b-4b87efe2c21e, identifier: UY14685
2026-03-30 11:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d0cbaa82-6b18-5548-813b-4b87efe2c21e with identifier: UY14685
2026-03-30 11:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d0cbaa82-6b18-5548-813b-4b87efe2c21e with identifier: UY14685
2026-03-30 11:12:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d0cbaa82-6b18-5548-813b-4b87efe2c21e with identifier: UY14685 to the API
2026-03-30 11:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UY14685>
{'auction_title': '',
'c_o_2_emission_value': 97,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:19:06Z',
'fuel_type': 'diesel',
'id': 'd0cbaa82-6b18-5548-813b-4b87efe2c21e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY14685',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 205872,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img48/98/48987dc5727c88449c169f6e378150a1/pa/UY14685_6fce5b6f4ee8f19ddea34c619b9f7371.jpg',
'https://img-pa.auto1.com/img48/98/48987dc5727c88449c169f6e378150a1/pa/UY14685_46bc8374deeee3a7dd3828e2fc3510bf.jpg',
'https://img-pa.auto1.com/img48/98/48987dc5727c88449c169f6e378150a1/pa/UY14685_1b31b945927a394dcc6d605e00bf5b6f.jpg',
'https://img-pa.auto1.com/img48/98/48987dc5727c88449c169f6e378150a1/pa/UY14685_110cb154e9aaf566ff0a519a78101030.jpg',
'https://img-pa.auto1.com/img48/98/48987dc5727c88449c169f6e378150a1/pa/UY14685_78f7646e9716d2cd2abdeaef510c7406.jpg',
'https://img-pa.auto1.com/img48/98/48987dc5727c88449c169f6e378150a1/pa/UY14685_45a4447f399c3b8a8236c1804e944254.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0cbaa82-6b18-5548-813b-4b87efe2c21e/d0cbaa82-6b18-5548-813b-4b87efe2c21e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/98/48987dc5727c88449c169f6e378150a1/pa/UY14685_6fce5b6f4ee8f19ddea34c619b9f7371.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0cbaa82-6b18-5548-813b-4b87efe2c21e/d0cbaa82-6b18-5548-813b-4b87efe2c21e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55934,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/98/48987dc5727c88449c169f6e378150a1/pa/UY14685_46bc8374deeee3a7dd3828e2fc3510bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0cbaa82-6b18-5548-813b-4b87efe2c21e/d0cbaa82-6b18-5548-813b-4b87efe2c21e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40760,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/98/48987dc5727c88449c169f6e378150a1/pa/UY14685_1b31b945927a394dcc6d605e00bf5b6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0cbaa82-6b18-5548-813b-4b87efe2c21e/d0cbaa82-6b18-5548-813b-4b87efe2c21e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79639,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/98/48987dc5727c88449c169f6e378150a1/pa/UY14685_110cb154e9aaf566ff0a519a78101030.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0cbaa82-6b18-5548-813b-4b87efe2c21e/d0cbaa82-6b18-5548-813b-4b87efe2c21e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100412,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/98/48987dc5727c88449c169f6e378150a1/pa/UY14685_78f7646e9716d2cd2abdeaef510c7406.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0cbaa82-6b18-5548-813b-4b87efe2c21e/d0cbaa82-6b18-5548-813b-4b87efe2c21e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54565,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/98/48987dc5727c88449c169f6e378150a1/pa/UY14685_45a4447f399c3b8a8236c1804e944254.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-12-08',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Ibiza 1.4 TDI FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2015}
2026-03-30 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY14685%27 HTTP/1.1" 200 None
2026-03-30 11:12:22 [auto1.fr] INFO: Saving data for UY14685: {'created_time': 1774869142.442907, 'last_price_update_time': 1774869142.442918, 'auction_closing_time': 1774970346.0}
2026-03-30 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UY14685') HTTP/1.1" 204 0
2026-03-30 11:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB27463> (referer: https://www.auto1.com/v1/car-details-view/MB27463/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e37a93b0-ec58-555a-9436-d227638154ca with identifier: MB27463
2026-03-30 11:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e37a93b0-ec58-555a-9436-d227638154ca with scrape type 1
2026-03-30 11:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e37a93b0-ec58-555a-9436-d227638154ca
2026-03-30 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F3c%252F1b3c876301f4dc31f30f19e723392da2%252Fpa%252FMB27463_fecd62e4bb896671ec9a9bd0591f4c32.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/3c/1b3c876301f4dc31f30f19e723392da2/pa/MB27463_fecd62e4bb896671ec9a9bd0591f4c32.jpg already downloaded
2026-03-30 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F3c%252F1b3c876301f4dc31f30f19e723392da2%252Fpa%252FMB27463_6f2a8f2a374843944b7a17bf73179957.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/3c/1b3c876301f4dc31f30f19e723392da2/pa/MB27463_6f2a8f2a374843944b7a17bf73179957.jpg already downloaded
2026-03-30 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F3c%252F1b3c876301f4dc31f30f19e723392da2%252Fpa%252FMB27463_4c1f05b8055e0d6dd5e1b40ad0848e78.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/3c/1b3c876301f4dc31f30f19e723392da2/pa/MB27463_4c1f05b8055e0d6dd5e1b40ad0848e78.jpg already downloaded
2026-03-30 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F3c%252F1b3c876301f4dc31f30f19e723392da2%252Fpa%252FMB27463_626237504ce89d0d73362b403a4e24e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/3c/1b3c876301f4dc31f30f19e723392da2/pa/MB27463_626237504ce89d0d73362b403a4e24e5.jpg already downloaded
2026-03-30 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F3c%252F1b3c876301f4dc31f30f19e723392da2%252Fpa%252FMB27463_38ec71f00052c8ff1662783b944ee0ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/3c/1b3c876301f4dc31f30f19e723392da2/pa/MB27463_38ec71f00052c8ff1662783b944ee0ce.jpg already downloaded
2026-03-30 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F3c%252F1b3c876301f4dc31f30f19e723392da2%252Fpa%252FMB27463_a063e198f132ba5485a27486a7f43a97.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/3c/1b3c876301f4dc31f30f19e723392da2/pa/MB27463_a063e198f132ba5485a27486a7f43a97.jpg already downloaded
2026-03-30 11:12:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e37a93b0-ec58-555a-9436-d227638154ca, identifier: MB27463
2026-03-30 11:12:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e37a93b0-ec58-555a-9436-d227638154ca with identifier: MB27463
2026-03-30 11:12:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e37a93b0-ec58-555a-9436-d227638154ca with identifier: MB27463
2026-03-30 11:12:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e37a93b0-ec58-555a-9436-d227638154ca with identifier: MB27463 to the API
2026-03-30 11:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MB27463>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:08:14Z',
'fuel_type': 'diesel',
'id': 'e37a93b0-ec58-555a-9436-d227638154ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB27463',
'listing': 'auction',
'location': 'FR, Vezin-le-Coquet',
'make': 'Peugeot',
'model': '3008',
'odometer': 296542,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img1b/3c/1b3c876301f4dc31f30f19e723392da2/pa/MB27463_fecd62e4bb896671ec9a9bd0591f4c32.jpg',
'https://img-pa.auto1.com/img1b/3c/1b3c876301f4dc31f30f19e723392da2/pa/MB27463_6f2a8f2a374843944b7a17bf73179957.jpg',
'https://img-pa.auto1.com/img1b/3c/1b3c876301f4dc31f30f19e723392da2/pa/MB27463_4c1f05b8055e0d6dd5e1b40ad0848e78.jpg',
'https://img-pa.auto1.com/img1b/3c/1b3c876301f4dc31f30f19e723392da2/pa/MB27463_626237504ce89d0d73362b403a4e24e5.jpg',
'https://img-pa.auto1.com/img1b/3c/1b3c876301f4dc31f30f19e723392da2/pa/MB27463_38ec71f00052c8ff1662783b944ee0ce.jpg',
'https://img-pa.auto1.com/img1b/3c/1b3c876301f4dc31f30f19e723392da2/pa/MB27463_a063e198f132ba5485a27486a7f43a97.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37a93b0-ec58-555a-9436-d227638154ca/e37a93b0-ec58-555a-9436-d227638154ca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80746,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/3c/1b3c876301f4dc31f30f19e723392da2/pa/MB27463_fecd62e4bb896671ec9a9bd0591f4c32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37a93b0-ec58-555a-9436-d227638154ca/e37a93b0-ec58-555a-9436-d227638154ca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77778,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/3c/1b3c876301f4dc31f30f19e723392da2/pa/MB27463_6f2a8f2a374843944b7a17bf73179957.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37a93b0-ec58-555a-9436-d227638154ca/e37a93b0-ec58-555a-9436-d227638154ca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/3c/1b3c876301f4dc31f30f19e723392da2/pa/MB27463_4c1f05b8055e0d6dd5e1b40ad0848e78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37a93b0-ec58-555a-9436-d227638154ca/e37a93b0-ec58-555a-9436-d227638154ca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58975,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/3c/1b3c876301f4dc31f30f19e723392da2/pa/MB27463_626237504ce89d0d73362b403a4e24e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37a93b0-ec58-555a-9436-d227638154ca/e37a93b0-ec58-555a-9436-d227638154ca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/3c/1b3c876301f4dc31f30f19e723392da2/pa/MB27463_38ec71f00052c8ff1662783b944ee0ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37a93b0-ec58-555a-9436-d227638154ca/e37a93b0-ec58-555a-9436-d227638154ca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38247,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/3c/1b3c876301f4dc31f30f19e723392da2/pa/MB27463_a063e198f132ba5485a27486a7f43a97.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-04-17',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 HDi Confort Pack',
'transmission': 'manual',
'trim': 'Confort Pack',
'year': 2011}
2026-03-30 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB27463%27 HTTP/1.1" 200 None
2026-03-30 11:12:26 [auto1.fr] INFO: Saving data for MB27463: {'created_time': 1774869146.807435, 'last_price_update_time': 1774869146.807446, 'auction_closing_time': 1774969694.0}
2026-03-30 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MB27463') HTTP/1.1" 204 0
2026-03-30 11:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:40 [auto1.fr] INFO: Channel: 24h | Page: 5 | totalHits: 5550 | hits on page: 40
2026-03-30 11:12:40 [auto1.fr] INFO: Found listing with ID: GH19552
2026-03-30 11:12:40 [auto1.fr] INFO: Found listing with ID: DS36987
2026-03-30 11:12:40 [auto1.fr] INFO: Found listing with ID: AL67797
2026-03-30 11:12:40 [auto1.fr] INFO: Found listing with ID: BV40330
2026-03-30 11:12:40 [auto1.fr] INFO: Found listing with ID: LW97985
2026-03-30 11:12:40 [auto1.fr] INFO: Found listing with ID: CH34160
2026-03-30 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH34160%27 HTTP/1.1" 200 None
2026-03-30 11:12:40 [auto1.fr] INFO: Scrape type for CH34160: 2
2026-03-30 11:12:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9ef170e-e716-5e03-a5db-310c5a16eeff with identifier: CH34160
2026-03-30 11:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9ef170e-e716-5e03-a5db-310c5a16eeff with scrape type 2
2026-03-30 11:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9ef170e-e716-5e03-a5db-310c5a16eeff with scrape type 2
2026-03-30 11:12:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e9ef170e-e716-5e03-a5db-310c5a16eeff, identifier: CH34160
2026-03-30 11:12:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e9ef170e-e716-5e03-a5db-310c5a16eeff with identifier: CH34160
2026-03-30 11:12:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e9ef170e-e716-5e03-a5db-310c5a16eeff with identifier: CH34160
2026-03-30 11:12:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e9ef170e-e716-5e03-a5db-310c5a16eeff with identifier: CH34160 to the API
2026-03-30 11:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:49:35Z',
'fuel_type': 'diesel',
'id': 'e9ef170e-e716-5e03-a5db-310c5a16eeff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH34160',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 189818,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-10',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Comfortline 4Motion BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Comfortline 4Motion BlueMotion Tech',
'year': 2016}
2026-03-30 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH34160%27 HTTP/1.1" 200 None
2026-03-30 11:12:41 [auto1.fr] INFO: Saving data for CH34160: {'auction_closing_time': 1774972175.0, 'created_time': 1772127589.891822, 'last_price_update_time': 1774869161.117389}
2026-03-30 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CH34160') HTTP/1.1" 204 0
2026-03-30 11:12:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:41 [auto1.fr] INFO: Found listing with ID: VU62913
2026-03-30 11:12:41 [auto1.fr] INFO: Found listing with ID: LH64935
2026-03-30 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH64935%27 HTTP/1.1" 200 None
2026-03-30 11:12:41 [auto1.fr] INFO: Scrape type for LH64935: 2
2026-03-30 11:12:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a245aa2-65eb-553a-b037-68eff64dcb76 with identifier: LH64935
2026-03-30 11:12:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a245aa2-65eb-553a-b037-68eff64dcb76 with scrape type 2
2026-03-30 11:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a245aa2-65eb-553a-b037-68eff64dcb76 with scrape type 2
2026-03-30 11:12:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6a245aa2-65eb-553a-b037-68eff64dcb76, identifier: LH64935
2026-03-30 11:12:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6a245aa2-65eb-553a-b037-68eff64dcb76 with identifier: LH64935
2026-03-30 11:12:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6a245aa2-65eb-553a-b037-68eff64dcb76 with identifier: LH64935
2026-03-30 11:12:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6a245aa2-65eb-553a-b037-68eff64dcb76 with identifier: LH64935 to the API
2026-03-30 11:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:28:42Z',
'fuel_type': 'diesel',
'id': '6a245aa2-65eb-553a-b037-68eff64dcb76',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH64935',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-12',
'seller_name': None,
'title': 'Renault Grand Scenic 1.6 dCi Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2015}
2026-03-30 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH64935%27 HTTP/1.1" 200 None
2026-03-30 11:12:41 [auto1.fr] INFO: Saving data for LH64935: {'auction_closing_time': 1774970922.0, 'created_time': 1773864489.922593, 'last_price_update_time': 1774869161.670831}
2026-03-30 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LH64935') HTTP/1.1" 204 0
2026-03-30 11:12:41 [auto1.fr] INFO: Found listing with ID: MB54534
2026-03-30 11:12:41 [auto1.fr] INFO: Found listing with ID: ZZ76181
2026-03-30 11:12:41 [auto1.fr] INFO: Found listing with ID: RD23036
2026-03-30 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD23036%27 HTTP/1.1" 200 None
2026-03-30 11:12:41 [auto1.fr] INFO: Scrape type for RD23036: 0
2026-03-30 11:12:41 [auto1.fr] INFO: Found listing with ID: XZ61201
2026-03-30 11:12:41 [auto1.fr] INFO: Found listing with ID: XR77162
2026-03-30 11:12:41 [auto1.fr] INFO: Found listing with ID: KZ21626
2026-03-30 11:12:41 [auto1.fr] INFO: Found listing with ID: WA74710
2026-03-30 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA74710%27 HTTP/1.1" 200 None
2026-03-30 11:12:41 [auto1.fr] INFO: Scrape type for WA74710: 1
2026-03-30 11:12:41 [auto1.fr] INFO: Found listing with ID: MZ88866
2026-03-30 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ88866%27 HTTP/1.1" 200 None
2026-03-30 11:12:41 [auto1.fr] INFO: Scrape type for MZ88866: 2
2026-03-30 11:12:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d86515f-d70f-5122-a2e8-140a5f7f5acd with identifier: MZ88866
2026-03-30 11:12:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d86515f-d70f-5122-a2e8-140a5f7f5acd with scrape type 2
2026-03-30 11:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d86515f-d70f-5122-a2e8-140a5f7f5acd with scrape type 2
2026-03-30 11:12:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5d86515f-d70f-5122-a2e8-140a5f7f5acd, identifier: MZ88866
2026-03-30 11:12:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5d86515f-d70f-5122-a2e8-140a5f7f5acd with identifier: MZ88866
2026-03-30 11:12:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5d86515f-d70f-5122-a2e8-140a5f7f5acd with identifier: MZ88866
2026-03-30 11:12:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5d86515f-d70f-5122-a2e8-140a5f7f5acd with identifier: MZ88866 to the API
2026-03-30 11:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:31:18Z',
'fuel_type': 'diesel',
'id': '5d86515f-d70f-5122-a2e8-140a5f7f5acd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ88866',
'listing': 'auction',
'make': 'Toyota',
'model': 'ProAce Verso',
'odometer': 132859,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-29',
'seller_name': None,
'title': 'Toyota ProAce Verso 2.0 D-4D L1 Dynamic',
'transmission': 'manual',
'trim': 'L1 Dynamic',
'year': 2018}
2026-03-30 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ88866%27 HTTP/1.1" 200 None
2026-03-30 11:12:42 [auto1.fr] INFO: Saving data for MZ88866: {'auction_closing_time': 1774971078.0, 'created_time': 1774279307.040639, 'last_price_update_time': 1774869162.171909}
2026-03-30 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MZ88866') HTTP/1.1" 204 0
2026-03-30 11:12:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:42 [auto1.fr] INFO: Found listing with ID: AJ87343
2026-03-30 11:12:42 [auto1.fr] INFO: Found listing with ID: HL88307
2026-03-30 11:12:42 [auto1.fr] INFO: Found listing with ID: VA96032
2026-03-30 11:12:42 [auto1.fr] INFO: Found listing with ID: LL20734
2026-03-30 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL20734%27 HTTP/1.1" 200 None
2026-03-30 11:12:42 [auto1.fr] INFO: Scrape type for LL20734: 2
2026-03-30 11:12:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a09f146-7876-5100-ae05-10be772ff55e with identifier: LL20734
2026-03-30 11:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a09f146-7876-5100-ae05-10be772ff55e with scrape type 2
2026-03-30 11:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a09f146-7876-5100-ae05-10be772ff55e with scrape type 2
2026-03-30 11:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8a09f146-7876-5100-ae05-10be772ff55e, identifier: LL20734
2026-03-30 11:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8a09f146-7876-5100-ae05-10be772ff55e with identifier: LL20734
2026-03-30 11:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8a09f146-7876-5100-ae05-10be772ff55e with identifier: LL20734
2026-03-30 11:12:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8a09f146-7876-5100-ae05-10be772ff55e with identifier: LL20734 to the API
2026-03-30 11:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:26:05Z',
'fuel_type': 'petrol',
'id': '8a09f146-7876-5100-ae05-10be772ff55e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL20734',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 59138,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-26',
'seller_name': None,
'title': 'Citroen C4 1.2 e-THP Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2016}
2026-03-30 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL20734%27 HTTP/1.1" 200 None
2026-03-30 11:12:42 [auto1.fr] INFO: Saving data for LL20734: {'auction_closing_time': 1774970765.0, 'created_time': 1773675418.052763, 'last_price_update_time': 1774869162.623571}
2026-03-30 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LL20734') HTTP/1.1" 204 0
2026-03-30 11:12:42 [auto1.fr] INFO: Found listing with ID: VN69868
2026-03-30 11:12:42 [auto1.fr] INFO: Found listing with ID: NU64384
2026-03-30 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU64384%27 HTTP/1.1" 200 None
2026-03-30 11:12:42 [auto1.fr] INFO: Scrape type for NU64384: 0
2026-03-30 11:12:42 [auto1.fr] INFO: Found listing with ID: TR16969
2026-03-30 11:12:42 [auto1.fr] INFO: Found listing with ID: US48890
2026-03-30 11:12:42 [auto1.fr] INFO: Found listing with ID: SV11482
2026-03-30 11:12:42 [auto1.fr] INFO: Found listing with ID: AX27193
2026-03-30 11:12:42 [auto1.fr] INFO: Found listing with ID: FJ22847
2026-03-30 11:12:42 [auto1.fr] INFO: Found listing with ID: GZ22446
2026-03-30 11:12:42 [auto1.fr] INFO: Found listing with ID: TW15870
2026-03-30 11:12:42 [auto1.fr] INFO: Found listing with ID: XH52609
2026-03-30 11:12:42 [auto1.fr] INFO: Found listing with ID: XC78678
2026-03-30 11:12:42 [auto1.fr] INFO: Found listing with ID: CR01658
2026-03-30 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR01658%27 HTTP/1.1" 200 None
2026-03-30 11:12:42 [auto1.fr] INFO: Scrape type for CR01658: 2
2026-03-30 11:12:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 754c9118-745e-57f2-9d3b-7330fe36c22d with identifier: CR01658
2026-03-30 11:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 754c9118-745e-57f2-9d3b-7330fe36c22d with scrape type 2
2026-03-30 11:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 754c9118-745e-57f2-9d3b-7330fe36c22d with scrape type 2
2026-03-30 11:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 754c9118-745e-57f2-9d3b-7330fe36c22d, identifier: CR01658
2026-03-30 11:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 754c9118-745e-57f2-9d3b-7330fe36c22d with identifier: CR01658
2026-03-30 11:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 754c9118-745e-57f2-9d3b-7330fe36c22d with identifier: CR01658
2026-03-30 11:12:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 754c9118-745e-57f2-9d3b-7330fe36c22d with identifier: CR01658 to the API
2026-03-30 11:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:13:58Z',
'fuel_type': 'diesel',
'id': '754c9118-745e-57f2-9d3b-7330fe36c22d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR01658',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 234377,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-29',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TDI BlueMotion',
'transmission': 'manual',
'trim': 'BlueMotion',
'year': 2011}
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR01658%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.fr] INFO: Saving data for CR01658: {'auction_closing_time': 1774970038.0, 'created_time': 1773675653.825945, 'last_price_update_time': 1774869163.200577}
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CR01658') HTTP/1.1" 204 0
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: KB47626
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB47626%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.fr] INFO: Scrape type for KB47626: 0
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: FC26231
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: NB97574
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: EX66754
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: ZK10369
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: LW54010
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: CS58382
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: AW86317
2026-03-30 11:12:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:46 [auto1.fr] INFO: Channel: 24h | Page: 6 | totalHits: 5550 | hits on page: 40
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: AL79561
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: CR50273
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: VG72144
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG72144%27 HTTP/1.1" 200 None
2026-03-30 11:12:46 [auto1.fr] INFO: Scrape type for VG72144: 0
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: WB58919
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB58919%27 HTTP/1.1" 200 None
2026-03-30 11:12:46 [auto1.fr] INFO: Scrape type for WB58919: 2
2026-03-30 11:12:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 689a11aa-da97-5bc4-bd4a-8a4deddbd2c3 with identifier: WB58919
2026-03-30 11:12:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 689a11aa-da97-5bc4-bd4a-8a4deddbd2c3 with scrape type 2
2026-03-30 11:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 689a11aa-da97-5bc4-bd4a-8a4deddbd2c3 with scrape type 2
2026-03-30 11:12:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 689a11aa-da97-5bc4-bd4a-8a4deddbd2c3, identifier: WB58919
2026-03-30 11:12:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 689a11aa-da97-5bc4-bd4a-8a4deddbd2c3 with identifier: WB58919
2026-03-30 11:12:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 689a11aa-da97-5bc4-bd4a-8a4deddbd2c3 with identifier: WB58919
2026-03-30 11:12:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 689a11aa-da97-5bc4-bd4a-8a4deddbd2c3 with identifier: WB58919 to the API
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 340,
'expiration_date': '2026-03-31T15:17:30Z',
'fuel_type': 'petrol',
'id': '689a11aa-da97-5bc4-bd4a-8a4deddbd2c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB58919',
'listing': 'auction',
'make': 'Audi',
'model': 'Q7',
'odometer': 139448,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-28',
'seller_name': None,
'title': 'Audi Q7 55 TFSI Mild-Hybrid quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2021}
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB58919%27 HTTP/1.1" 200 None
2026-03-30 11:12:46 [auto1.fr] INFO: Saving data for WB58919: {'auction_closing_time': 1774970250.0, 'created_time': 1774471437.844896, 'last_price_update_time': 1774869166.734543}
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WB58919') HTTP/1.1" 204 0
2026-03-30 11:12:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: AZ00821
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: GA93481
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: UC26972
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: NH21299
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: CP39299
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: WS13608
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: PU29197
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: XT72733
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: LF56944
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: UH12185
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UH12185%27 HTTP/1.1" 200 None
2026-03-30 11:12:46 [auto1.fr] INFO: Scrape type for UH12185: 1
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: DZ81197
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DZ81197%27 HTTP/1.1" 200 None
2026-03-30 11:12:46 [auto1.fr] INFO: Scrape type for DZ81197: 2
2026-03-30 11:12:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c324ddf5-2882-5fa9-9487-053f6e812958 with identifier: DZ81197
2026-03-30 11:12:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c324ddf5-2882-5fa9-9487-053f6e812958 with scrape type 2
2026-03-30 11:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c324ddf5-2882-5fa9-9487-053f6e812958 with scrape type 2
2026-03-30 11:12:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c324ddf5-2882-5fa9-9487-053f6e812958, identifier: DZ81197
2026-03-30 11:12:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c324ddf5-2882-5fa9-9487-053f6e812958 with identifier: DZ81197
2026-03-30 11:12:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c324ddf5-2882-5fa9-9487-053f6e812958 with identifier: DZ81197
2026-03-30 11:12:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c324ddf5-2882-5fa9-9487-053f6e812958 with identifier: DZ81197 to the API
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:08:45Z',
'fuel_type': 'petrol',
'id': 'c324ddf5-2882-5fa9-9487-053f6e812958',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ81197',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 131278,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-11',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Like',
'transmission': 'manual',
'trim': 'Like',
'year': 2017}
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DZ81197%27 HTTP/1.1" 200 None
2026-03-30 11:12:47 [auto1.fr] INFO: Saving data for DZ81197: {'auction_closing_time': 1774969725.0, 'created_time': 1774642663.603397, 'last_price_update_time': 1774869167.346155}
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DZ81197') HTTP/1.1" 204 0
2026-03-30 11:12:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:47 [auto1.fr] INFO: Found listing with ID: MA18623
2026-03-30 11:12:47 [auto1.fr] INFO: Found listing with ID: TC25097
2026-03-30 11:12:47 [auto1.fr] INFO: Found listing with ID: WV40426
2026-03-30 11:12:47 [auto1.fr] INFO: Found listing with ID: KP00368
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP00368%27 HTTP/1.1" 200 None
2026-03-30 11:12:47 [auto1.fr] INFO: Scrape type for KP00368: 1
2026-03-30 11:12:47 [auto1.fr] INFO: Found listing with ID: KJ96172
2026-03-30 11:12:47 [auto1.fr] INFO: Found listing with ID: VP01929
2026-03-30 11:12:47 [auto1.fr] INFO: Found listing with ID: DN93409
2026-03-30 11:12:47 [auto1.fr] INFO: Found listing with ID: ZT48297
2026-03-30 11:12:47 [auto1.fr] INFO: Found listing with ID: JV70859
2026-03-30 11:12:47 [auto1.fr] INFO: Found listing with ID: XH92136
2026-03-30 11:12:47 [auto1.fr] INFO: Found listing with ID: NT04558
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT04558%27 HTTP/1.1" 200 None
2026-03-30 11:12:47 [auto1.fr] INFO: Scrape type for NT04558: 1
2026-03-30 11:12:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:47 [auto1.fr] INFO: Found listing with ID: BB11849
2026-03-30 11:12:47 [auto1.fr] INFO: Found listing with ID: XK65376
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK65376%27 HTTP/1.1" 200 None
2026-03-30 11:12:47 [auto1.fr] INFO: Scrape type for XK65376: 2
2026-03-30 11:12:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fe3a877-31d2-5fbf-accd-c6da8faf0667 with identifier: XK65376
2026-03-30 11:12:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fe3a877-31d2-5fbf-accd-c6da8faf0667 with scrape type 2
2026-03-30 11:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fe3a877-31d2-5fbf-accd-c6da8faf0667 with scrape type 2
2026-03-30 11:12:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6fe3a877-31d2-5fbf-accd-c6da8faf0667, identifier: XK65376
2026-03-30 11:12:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6fe3a877-31d2-5fbf-accd-c6da8faf0667 with identifier: XK65376
2026-03-30 11:12:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6fe3a877-31d2-5fbf-accd-c6da8faf0667 with identifier: XK65376
2026-03-30 11:12:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6fe3a877-31d2-5fbf-accd-c6da8faf0667 with identifier: XK65376 to the API
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:43:37Z',
'fuel_type': 'diesel',
'id': '6fe3a877-31d2-5fbf-accd-c6da8faf0667',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK65376',
'listing': 'auction',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 104762,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-08',
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
'transmission': 'manual',
'trim': 'Limited FWD',
'year': 2018}
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK65376%27 HTTP/1.1" 200 None
2026-03-30 11:12:47 [auto1.fr] INFO: Saving data for XK65376: {'auction_closing_time': 1774971817.0, 'created_time': 1773249393.716042, 'last_price_update_time': 1774869167.94687}
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XK65376') HTTP/1.1" 204 0
2026-03-30 11:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:48 [auto1.fr] INFO: Found listing with ID: LY92555
2026-03-30 11:12:48 [auto1.fr] INFO: Found listing with ID: YU12489
2026-03-30 11:12:48 [auto1.fr] INFO: Found listing with ID: ZN46810
2026-03-30 11:12:48 [auto1.fr] INFO: Found listing with ID: LW10952
2026-03-30 11:12:48 [auto1.fr] INFO: Found listing with ID: LT66464
2026-03-30 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT66464%27 HTTP/1.1" 200 None
2026-03-30 11:12:48 [auto1.fr] INFO: Scrape type for LT66464: 2
2026-03-30 11:12:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37039f96-ea56-59a2-8d42-9f1eb3b4693d with identifier: LT66464
2026-03-30 11:12:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37039f96-ea56-59a2-8d42-9f1eb3b4693d with scrape type 2
2026-03-30 11:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37039f96-ea56-59a2-8d42-9f1eb3b4693d with scrape type 2
2026-03-30 11:12:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 37039f96-ea56-59a2-8d42-9f1eb3b4693d, identifier: LT66464
2026-03-30 11:12:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 37039f96-ea56-59a2-8d42-9f1eb3b4693d with identifier: LT66464
2026-03-30 11:12:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 37039f96-ea56-59a2-8d42-9f1eb3b4693d with identifier: LT66464
2026-03-30 11:12:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 37039f96-ea56-59a2-8d42-9f1eb3b4693d with identifier: LT66464 to the API
2026-03-30 11:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-31T15:33:24Z',
'fuel_type': 'diesel',
'id': '37039f96-ea56-59a2-8d42-9f1eb3b4693d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT66464',
'listing': 'auction',
'make': 'Jaguar',
'model': 'F-Pace',
'odometer': 159899,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-09',
'seller_name': None,
'title': 'Jaguar F-Pace 20d R-Sport AWD',
'transmission': 'manual',
'trim': 'R-Sport AWD',
'year': 2017}
2026-03-30 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT66464%27 HTTP/1.1" 200 None
2026-03-30 11:12:48 [auto1.fr] INFO: Saving data for LT66464: {'auction_closing_time': 1774971204.0, 'created_time': 1772127577.180859, 'last_price_update_time': 1774869168.473165}
2026-03-30 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LT66464') HTTP/1.1" 204 0
2026-03-30 11:12:48 [auto1.fr] INFO: Found listing with ID: LW75647
2026-03-30 11:12:48 [auto1.fr] INFO: Found listing with ID: YJ52141
2026-03-30 11:12:48 [auto1.fr] INFO: Found listing with ID: KR46154
2026-03-30 11:12:48 [auto1.fr] INFO: Found listing with ID: YK40789
2026-03-30 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YK40789%27 HTTP/1.1" 200 None
2026-03-30 11:12:48 [auto1.fr] INFO: Scrape type for YK40789: 2
2026-03-30 11:12:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea22724c-3224-5ea4-b18a-70b830c97a61 with identifier: YK40789
2026-03-30 11:12:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea22724c-3224-5ea4-b18a-70b830c97a61 with scrape type 2
2026-03-30 11:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea22724c-3224-5ea4-b18a-70b830c97a61 with scrape type 2
2026-03-30 11:12:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ea22724c-3224-5ea4-b18a-70b830c97a61, identifier: YK40789
2026-03-30 11:12:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ea22724c-3224-5ea4-b18a-70b830c97a61 with identifier: YK40789
2026-03-30 11:12:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ea22724c-3224-5ea4-b18a-70b830c97a61 with identifier: YK40789
2026-03-30 11:12:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ea22724c-3224-5ea4-b18a-70b830c97a61 with identifier: YK40789 to the API
2026-03-30 11:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:41:26Z',
'fuel_type': 'diesel',
'id': 'ea22724c-3224-5ea4-b18a-70b830c97a61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK40789',
'listing': 'auction',
'make': 'Citroen',
'model': 'C5',
'odometer': 326784,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-20',
'seller_name': None,
'title': 'Citroen C5 2.0 HDi Millenium',
'transmission': 'manual',
'trim': 'Millenium',
'year': 2014}
2026-03-30 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YK40789%27 HTTP/1.1" 200 None
2026-03-30 11:12:48 [auto1.fr] INFO: Saving data for YK40789: {'auction_closing_time': 1774971686.0, 'created_time': 1774642698.367594, 'last_price_update_time': 1774869168.919415}
2026-03-30 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YK40789') HTTP/1.1" 204 0
2026-03-30 11:12:48 [auto1.fr] INFO: Found listing with ID: EY54413
2026-03-30 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY54413%27 HTTP/1.1" 200 None
2026-03-30 11:12:48 [auto1.fr] INFO: Scrape type for EY54413: 2
2026-03-30 11:12:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99f55a7d-ce70-54ec-8f50-6dec61c41cca with identifier: EY54413
2026-03-30 11:12:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99f55a7d-ce70-54ec-8f50-6dec61c41cca with scrape type 2
2026-03-30 11:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99f55a7d-ce70-54ec-8f50-6dec61c41cca with scrape type 2
2026-03-30 11:12:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 99f55a7d-ce70-54ec-8f50-6dec61c41cca, identifier: EY54413
2026-03-30 11:12:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 99f55a7d-ce70-54ec-8f50-6dec61c41cca with identifier: EY54413
2026-03-30 11:12:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 99f55a7d-ce70-54ec-8f50-6dec61c41cca with identifier: EY54413
2026-03-30 11:12:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 99f55a7d-ce70-54ec-8f50-6dec61c41cca with identifier: EY54413 to the API
2026-03-30 11:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:40:46Z',
'fuel_type': 'petrol',
'id': '99f55a7d-ce70-54ec-8f50-6dec61c41cca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY54413',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 140052,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-29',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.4 TSI ACT Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2016}
2026-03-30 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY54413%27 HTTP/1.1" 200 None
2026-03-30 11:12:49 [auto1.fr] INFO: Saving data for EY54413: {'auction_closing_time': 1774971646.0, 'created_time': 1773918490.103521, 'last_price_update_time': 1774869169.340861}
2026-03-30 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EY54413') HTTP/1.1" 204 0
2026-03-30 11:12:49 [auto1.fr] INFO: Found listing with ID: LZ23013
2026-03-30 11:12:49 [auto1.fr] INFO: Found listing with ID: RA80092
2026-03-30 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA80092%27 HTTP/1.1" 200 None
2026-03-30 11:12:49 [auto1.fr] INFO: Scrape type for RA80092: 1
2026-03-30 11:12:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP00368/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NT04558/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA80092/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP00368> (referer: https://www.auto1.com/v1/car-details-view/KP00368/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62c33e9e-a7e0-5502-a874-281632ef61c5 with identifier: KP00368
2026-03-30 11:12:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62c33e9e-a7e0-5502-a874-281632ef61c5 with scrape type 1
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 62c33e9e-a7e0-5502-a874-281632ef61c5
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe1%252F82e114a6aa2a96b8625366e971f63dbf%252Fpa%252FKP00368_e4b40237d9fe74dea8a00b15e9f9d4eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_e4b40237d9fe74dea8a00b15e9f9d4eb.jpg already downloaded
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe1%252F82e114a6aa2a96b8625366e971f63dbf%252Fpa%252FKP00368_41bf827f0756fcc4bb95f9f1f8c95948.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_41bf827f0756fcc4bb95f9f1f8c95948.jpg already downloaded
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe1%252F82e114a6aa2a96b8625366e971f63dbf%252Fpa%252FKP00368_1ef3b5094f9d76fcdf7f74bc0802c81e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_1ef3b5094f9d76fcdf7f74bc0802c81e.jpg already downloaded
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe1%252F82e114a6aa2a96b8625366e971f63dbf%252Fpa%252FKP00368_17106a9e823ebfc655c619f34ea3063a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_17106a9e823ebfc655c619f34ea3063a.jpg already downloaded
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe1%252F82e114a6aa2a96b8625366e971f63dbf%252Fpa%252FKP00368_fcd21c8710734d896b0b0c18ff039a3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_fcd21c8710734d896b0b0c18ff039a3a.jpg already downloaded
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe1%252F82e114a6aa2a96b8625366e971f63dbf%252Fpa%252FKP00368_a4462db93b6f2c713ac937ad96a1fe03.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_a4462db93b6f2c713ac937ad96a1fe03.jpg already downloaded
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe1%252F82e114a6aa2a96b8625366e971f63dbf%252Fpa%252FKP00368_7f59ebd738c664775d94add719bd51da.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_7f59ebd738c664775d94add719bd51da.jpg already downloaded
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe1%252F82e114a6aa2a96b8625366e971f63dbf%252Fpa%252FKP00368_0c7fe76b7184f9733d63afe5b4fffe91.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_0c7fe76b7184f9733d63afe5b4fffe91.jpg already downloaded
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe1%252F82e114a6aa2a96b8625366e971f63dbf%252Fpa%252FKP00368_35c29b8f2debdcf0f52344fb0b4720d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_35c29b8f2debdcf0f52344fb0b4720d2.jpg already downloaded
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fe1%252F82e114a6aa2a96b8625366e971f63dbf%252Fpa%252FKP00368_d65c41adb5f03d6c648fe90c2e7edc24.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_d65c41adb5f03d6c648fe90c2e7edc24.jpg already downloaded
2026-03-30 11:12:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 62c33e9e-a7e0-5502-a874-281632ef61c5, identifier: KP00368
2026-03-30 11:12:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 62c33e9e-a7e0-5502-a874-281632ef61c5 with identifier: KP00368
2026-03-30 11:12:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 62c33e9e-a7e0-5502-a874-281632ef61c5 with identifier: KP00368
2026-03-30 11:12:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 62c33e9e-a7e0-5502-a874-281632ef61c5 with identifier: KP00368 to the API
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KP00368>
{'auction_title': '',
'c_o_2_emission_value': 85,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 92,
'expiration_date': '2026-03-31T15:39:48Z',
'fuel_type': 'diesel',
'id': '62c33e9e-a7e0-5502-a874-281632ef61c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP00368',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Peugeot',
'model': '208',
'odometer': 202634,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photo_urls': ['https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_e4b40237d9fe74dea8a00b15e9f9d4eb.jpg',
'https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_41bf827f0756fcc4bb95f9f1f8c95948.jpg',
'https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_1ef3b5094f9d76fcdf7f74bc0802c81e.jpg',
'https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_17106a9e823ebfc655c619f34ea3063a.jpg',
'https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_fcd21c8710734d896b0b0c18ff039a3a.jpg',
'https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_a4462db93b6f2c713ac937ad96a1fe03.jpg',
'https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_7f59ebd738c664775d94add719bd51da.jpg',
'https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_0c7fe76b7184f9733d63afe5b4fffe91.jpg',
'https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_35c29b8f2debdcf0f52344fb0b4720d2.jpg',
'https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_d65c41adb5f03d6c648fe90c2e7edc24.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c33e9e-a7e0-5502-a874-281632ef61c5/62c33e9e-a7e0-5502-a874-281632ef61c5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112203,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_e4b40237d9fe74dea8a00b15e9f9d4eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c33e9e-a7e0-5502-a874-281632ef61c5/62c33e9e-a7e0-5502-a874-281632ef61c5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109009,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_41bf827f0756fcc4bb95f9f1f8c95948.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c33e9e-a7e0-5502-a874-281632ef61c5/62c33e9e-a7e0-5502-a874-281632ef61c5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114522,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_1ef3b5094f9d76fcdf7f74bc0802c81e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c33e9e-a7e0-5502-a874-281632ef61c5/62c33e9e-a7e0-5502-a874-281632ef61c5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_17106a9e823ebfc655c619f34ea3063a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c33e9e-a7e0-5502-a874-281632ef61c5/62c33e9e-a7e0-5502-a874-281632ef61c5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103063,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_fcd21c8710734d896b0b0c18ff039a3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c33e9e-a7e0-5502-a874-281632ef61c5/62c33e9e-a7e0-5502-a874-281632ef61c5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_a4462db93b6f2c713ac937ad96a1fe03.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c33e9e-a7e0-5502-a874-281632ef61c5/62c33e9e-a7e0-5502-a874-281632ef61c5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110604,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_7f59ebd738c664775d94add719bd51da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c33e9e-a7e0-5502-a874-281632ef61c5/62c33e9e-a7e0-5502-a874-281632ef61c5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101130,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_0c7fe76b7184f9733d63afe5b4fffe91.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c33e9e-a7e0-5502-a874-281632ef61c5/62c33e9e-a7e0-5502-a874-281632ef61c5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66808,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_35c29b8f2debdcf0f52344fb0b4720d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c33e9e-a7e0-5502-a874-281632ef61c5/62c33e9e-a7e0-5502-a874-281632ef61c5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63143,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/e1/82e114a6aa2a96b8625366e971f63dbf/pa/KP00368_d65c41adb5f03d6c648fe90c2e7edc24.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-05-01',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.6 HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2014}
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP00368%27 HTTP/1.1" 200 None
2026-03-30 11:12:59 [auto1.fr] INFO: Saving data for KP00368: {'created_time': 1774869179.388354, 'last_price_update_time': 1774869179.388363, 'auction_closing_time': 1774971588.0}
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KP00368') HTTP/1.1" 204 0
2026-03-30 11:12:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:59 [auto1.fr] INFO: Channel: 24h | Page: 7 | totalHits: 5552 | hits on page: 40
2026-03-30 11:12:59 [auto1.fr] INFO: Found listing with ID: LZ23013
2026-03-30 11:12:59 [auto1.fr] INFO: Found listing with ID: RA80092
2026-03-30 11:12:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:59 [auto1.fr] INFO: Found listing with ID: FJ82721
2026-03-30 11:12:59 [auto1.fr] INFO: Found listing with ID: KU85731
2026-03-30 11:12:59 [auto1.fr] INFO: Found listing with ID: YG09777
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG09777%27 HTTP/1.1" 200 None
2026-03-30 11:12:59 [auto1.fr] INFO: Scrape type for YG09777: 2
2026-03-30 11:12:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a47932c-00ce-54ce-a9d0-01a0ca9eb678 with identifier: YG09777
2026-03-30 11:12:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a47932c-00ce-54ce-a9d0-01a0ca9eb678 with scrape type 2
2026-03-30 11:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a47932c-00ce-54ce-a9d0-01a0ca9eb678 with scrape type 2
2026-03-30 11:12:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1a47932c-00ce-54ce-a9d0-01a0ca9eb678, identifier: YG09777
2026-03-30 11:12:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1a47932c-00ce-54ce-a9d0-01a0ca9eb678 with identifier: YG09777
2026-03-30 11:12:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1a47932c-00ce-54ce-a9d0-01a0ca9eb678 with identifier: YG09777
2026-03-30 11:12:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1a47932c-00ce-54ce-a9d0-01a0ca9eb678 with identifier: YG09777 to the API
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:07:39Z',
'fuel_type': 'petrol',
'id': '1a47932c-00ce-54ce-a9d0-01a0ca9eb678',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG09777',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 63193,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-17',
'seller_name': None,
'title': 'Peugeot 208 1.2 e-THP Roland Garros',
'transmission': 'manual',
'trim': 'Roland Garros',
'year': 2017}
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG09777%27 HTTP/1.1" 200 None
2026-03-30 11:13:00 [auto1.fr] INFO: Saving data for YG09777: {'auction_closing_time': 1774969659.0, 'created_time': 1774278863.405845, 'last_price_update_time': 1774869180.02432}
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YG09777') HTTP/1.1" 204 0
2026-03-30 11:13:00 [auto1.fr] INFO: Found listing with ID: XC64901
2026-03-30 11:13:00 [auto1.fr] INFO: Found listing with ID: GD84445
2026-03-30 11:13:00 [auto1.fr] INFO: Found listing with ID: CN95140
2026-03-30 11:13:00 [auto1.fr] INFO: Found listing with ID: LJ04008
2026-03-30 11:13:00 [auto1.fr] INFO: Found listing with ID: TF16696
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF16696%27 HTTP/1.1" 200 None
2026-03-30 11:13:00 [auto1.fr] INFO: Scrape type for TF16696: 0
2026-03-30 11:13:00 [auto1.fr] INFO: Found listing with ID: KK63519
2026-03-30 11:13:00 [auto1.fr] INFO: Found listing with ID: RL53733
2026-03-30 11:13:00 [auto1.fr] INFO: Found listing with ID: UG05877
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG05877%27 HTTP/1.1" 200 None
2026-03-30 11:13:00 [auto1.fr] INFO: Scrape type for UG05877: 1
2026-03-30 11:13:00 [auto1.fr] INFO: Found listing with ID: YS05560
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS05560%27 HTTP/1.1" 200 None
2026-03-30 11:13:00 [auto1.fr] INFO: Scrape type for YS05560: 2
2026-03-30 11:13:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0fabe4d-ab4f-59bd-a08f-96298121e5f1 with identifier: YS05560
2026-03-30 11:13:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0fabe4d-ab4f-59bd-a08f-96298121e5f1 with scrape type 2
2026-03-30 11:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0fabe4d-ab4f-59bd-a08f-96298121e5f1 with scrape type 2
2026-03-30 11:13:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a0fabe4d-ab4f-59bd-a08f-96298121e5f1, identifier: YS05560
2026-03-30 11:13:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a0fabe4d-ab4f-59bd-a08f-96298121e5f1 with identifier: YS05560
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 11:13:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:13:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a0fabe4d-ab4f-59bd-a08f-96298121e5f1 with identifier: YS05560
2026-03-30 11:13:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a0fabe4d-ab4f-59bd-a08f-96298121e5f1 with identifier: YS05560 to the API
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-31T15:28:23Z',
'fuel_type': 'diesel',
'id': 'a0fabe4d-ab4f-59bd-a08f-96298121e5f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS05560',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 310716,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-12-08',
'seller_name': None,
'title': 'Renault Grand Scenic 2.0 dCi Privilege',
'transmission': 'manual',
'trim': 'Privilege',
'year': 2009}
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS05560%27 HTTP/1.1" 200 None
2026-03-30 11:13:00 [auto1.fr] INFO: Saving data for YS05560: {'auction_closing_time': 1774970903.0, 'created_time': 1774279020.842931, 'last_price_update_time': 1774869180.768444}
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YS05560') HTTP/1.1" 204 0
2026-03-30 11:13:00 [auto1.fr] INFO: Found listing with ID: KP55875
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP55875%27 HTTP/1.1" 200 None
2026-03-30 11:13:00 [auto1.fr] INFO: Scrape type for KP55875: 1
2026-03-30 11:13:00 [auto1.fr] INFO: Found listing with ID: EB66083
2026-03-30 11:13:00 [auto1.fr] INFO: Found listing with ID: XG43753
2026-03-30 11:13:00 [auto1.fr] INFO: Found listing with ID: KE63825
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KE63825%27 HTTP/1.1" 200 None
2026-03-30 11:13:00 [auto1.fr] INFO: Scrape type for KE63825: 2
2026-03-30 11:13:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88006b2f-08f1-5df3-ae03-6045847714c0 with identifier: KE63825
2026-03-30 11:13:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88006b2f-08f1-5df3-ae03-6045847714c0 with scrape type 2
2026-03-30 11:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88006b2f-08f1-5df3-ae03-6045847714c0 with scrape type 2
2026-03-30 11:13:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 88006b2f-08f1-5df3-ae03-6045847714c0, identifier: KE63825
2026-03-30 11:13:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 88006b2f-08f1-5df3-ae03-6045847714c0 with identifier: KE63825
2026-03-30 11:13:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 88006b2f-08f1-5df3-ae03-6045847714c0 with identifier: KE63825
2026-03-30 11:13:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 88006b2f-08f1-5df3-ae03-6045847714c0 with identifier: KE63825 to the API
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:55:42Z',
'fuel_type': 'diesel',
'id': '88006b2f-08f1-5df3-ae03-6045847714c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE63825',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 345371,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-29',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2015}
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KE63825%27 HTTP/1.1" 200 None
2026-03-30 11:13:01 [auto1.fr] INFO: Saving data for KE63825: {'auction_closing_time': 1774972542.0, 'created_time': 1773660197.891554, 'last_price_update_time': 1774869181.315328}
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KE63825') HTTP/1.1" 204 0
2026-03-30 11:13:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:01 [auto1.fr] INFO: Found listing with ID: FV31615
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV31615%27 HTTP/1.1" 200 None
2026-03-30 11:13:01 [auto1.fr] INFO: Scrape type for FV31615: 2
2026-03-30 11:13:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ad1be42-89df-5cff-8549-6a0b4f264db0 with identifier: FV31615
2026-03-30 11:13:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ad1be42-89df-5cff-8549-6a0b4f264db0 with scrape type 2
2026-03-30 11:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ad1be42-89df-5cff-8549-6a0b4f264db0 with scrape type 2
2026-03-30 11:13:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2ad1be42-89df-5cff-8549-6a0b4f264db0, identifier: FV31615
2026-03-30 11:13:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2ad1be42-89df-5cff-8549-6a0b4f264db0 with identifier: FV31615
2026-03-30 11:13:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2ad1be42-89df-5cff-8549-6a0b4f264db0 with identifier: FV31615
2026-03-30 11:13:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2ad1be42-89df-5cff-8549-6a0b4f264db0 with identifier: FV31615 to the API
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-31T15:34:08Z',
'fuel_type': 'diesel',
'id': '2ad1be42-89df-5cff-8549-6a0b4f264db0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV31615',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 201238,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-31',
'seller_name': None,
'title': 'Peugeot 3008 2.0 Blue-HDi GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2019}
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV31615%27 HTTP/1.1" 200 None
2026-03-30 11:13:01 [auto1.fr] INFO: Saving data for FV31615: {'auction_closing_time': 1774971248.0, 'created_time': 1774279302.97723, 'last_price_update_time': 1774869181.753089}
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FV31615') HTTP/1.1" 204 0
2026-03-30 11:13:01 [auto1.fr] INFO: Found listing with ID: GU57901
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU57901%27 HTTP/1.1" 200 None
2026-03-30 11:13:01 [auto1.fr] INFO: Scrape type for GU57901: 1
2026-03-30 11:13:01 [auto1.fr] INFO: Found listing with ID: ZS16688
2026-03-30 11:13:01 [auto1.fr] INFO: Found listing with ID: FY42182
2026-03-30 11:13:01 [auto1.fr] INFO: Found listing with ID: GN38354
2026-03-30 11:13:01 [auto1.fr] INFO: Found listing with ID: GV41171
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV41171%27 HTTP/1.1" 200 None
2026-03-30 11:13:01 [auto1.fr] INFO: Scrape type for GV41171: 0
2026-03-30 11:13:01 [auto1.fr] INFO: Found listing with ID: BL33771
2026-03-30 11:13:01 [auto1.fr] INFO: Found listing with ID: RZ77484
2026-03-30 11:13:01 [auto1.fr] INFO: Found listing with ID: RG39799
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG39799%27 HTTP/1.1" 200 None
2026-03-30 11:13:01 [auto1.fr] INFO: Scrape type for RG39799: 0
2026-03-30 11:13:01 [auto1.fr] INFO: Found listing with ID: AR51988
2026-03-30 11:13:01 [auto1.fr] INFO: Found listing with ID: GD65166
2026-03-30 11:13:01 [auto1.fr] INFO: Found listing with ID: VA51344
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VA51344%27 HTTP/1.1" 200 None
2026-03-30 11:13:01 [auto1.fr] INFO: Scrape type for VA51344: 1
2026-03-30 11:13:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:01 [auto1.fr] INFO: Found listing with ID: MP21660
2026-03-30 11:13:01 [auto1.fr] INFO: Found listing with ID: PF69474
2026-03-30 11:13:01 [auto1.fr] INFO: Found listing with ID: DW49496
2026-03-30 11:13:01 [auto1.fr] INFO: Found listing with ID: FB81487
2026-03-30 11:13:01 [auto1.fr] INFO: Found listing with ID: NY56342
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY56342%27 HTTP/1.1" 200 None
2026-03-30 11:13:01 [auto1.fr] INFO: Scrape type for NY56342: 2
2026-03-30 11:13:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9344d72-6f39-51b7-ae15-703c47389cef with identifier: NY56342
2026-03-30 11:13:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9344d72-6f39-51b7-ae15-703c47389cef with scrape type 2
2026-03-30 11:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9344d72-6f39-51b7-ae15-703c47389cef with scrape type 2
2026-03-30 11:13:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c9344d72-6f39-51b7-ae15-703c47389cef, identifier: NY56342
2026-03-30 11:13:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c9344d72-6f39-51b7-ae15-703c47389cef with identifier: NY56342
2026-03-30 11:13:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c9344d72-6f39-51b7-ae15-703c47389cef with identifier: NY56342
2026-03-30 11:13:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c9344d72-6f39-51b7-ae15-703c47389cef with identifier: NY56342 to the API
2026-03-30 11:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-31T15:52:39Z',
'fuel_type': 'diesel',
'id': 'c9344d72-6f39-51b7-ae15-703c47389cef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY56342',
'listing': 'auction',
'make': 'Peugeot',
'model': '508',
'odometer': 60677,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-20',
'seller_name': None,
'title': 'Peugeot 508 2.0 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2013}
2026-03-30 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY56342%27 HTTP/1.1" 200 None
2026-03-30 11:13:02 [auto1.fr] INFO: Saving data for NY56342: {'auction_closing_time': 1774972359.0, 'created_time': 1773832468.852928, 'last_price_update_time': 1774869182.314083}
2026-03-30 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NY56342') HTTP/1.1" 204 0
2026-03-30 11:13:02 [auto1.fr] INFO: Found listing with ID: LL57961
2026-03-30 11:13:02 [auto1.fr] INFO: Found listing with ID: PS75557
2026-03-30 11:13:02 [auto1.fr] INFO: Found listing with ID: UE94565
2026-03-30 11:13:02 [auto1.fr] INFO: Found listing with ID: HA13685
2026-03-30 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA13685%27 HTTP/1.1" 200 None
2026-03-30 11:13:02 [auto1.fr] INFO: Scrape type for HA13685: 1
2026-03-30 11:13:02 [auto1.fr] INFO: Found listing with ID: JZ33313
2026-03-30 11:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP55875/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GU57901/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA80092> (referer: https://www.auto1.com/v1/car-details-view/RA80092/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d with identifier: RA80092
2026-03-30 11:13:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d with scrape type 1
2026-03-30 11:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d
2026-03-30 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F95%252F3895f7b469f7fac1258475b30ac42764%252Fpa%252FRA80092_76fad17593aa4046084e1e4b749290d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_76fad17593aa4046084e1e4b749290d6.jpg not downloaded yet
2026-03-30 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F95%252F3895f7b469f7fac1258475b30ac42764%252Fpa%252FRA80092_d8e9e0ae2d64925c9944676ad1d4574e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_d8e9e0ae2d64925c9944676ad1d4574e.jpg not downloaded yet
2026-03-30 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F95%252F3895f7b469f7fac1258475b30ac42764%252Fpa%252FRA80092_cc1e4df1ea37df0c983432b2e44386c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_cc1e4df1ea37df0c983432b2e44386c8.jpg not downloaded yet
2026-03-30 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F95%252F3895f7b469f7fac1258475b30ac42764%252Fpa%252FRA80092_d72875fa5cfb22f46a612002f4b95116.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_d72875fa5cfb22f46a612002f4b95116.jpg not downloaded yet
2026-03-30 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F95%252F3895f7b469f7fac1258475b30ac42764%252Fpa%252FRA80092_0510327178f99ca00f06810bd337530a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_0510327178f99ca00f06810bd337530a.jpg not downloaded yet
2026-03-30 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F95%252F3895f7b469f7fac1258475b30ac42764%252Fpa%252FRA80092_2347df2e7c21b9cf3755ad30a6bb432a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_2347df2e7c21b9cf3755ad30a6bb432a.jpg not downloaded yet
2026-03-30 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F95%252F3895f7b469f7fac1258475b30ac42764%252Fpa%252FRA80092_96b35f54133cd0a14f3227f513d730a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_96b35f54133cd0a14f3227f513d730a0.jpg not downloaded yet
2026-03-30 11:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_d8e9e0ae2d64925c9944676ad1d4574e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_76fad17593aa4046084e1e4b749290d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F95%252F3895f7b469f7fac1258475b30ac42764%252Fpa%252FRA80092_10d9b78906a1cc958d1178cedd5c4a54.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_10d9b78906a1cc958d1178cedd5c4a54.jpg not downloaded yet
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F95%252F3895f7b469f7fac1258475b30ac42764%252Fpa%252FRA80092_f1cd40234c9787be603060384309ae99.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_f1cd40234c9787be603060384309ae99.jpg not downloaded yet
2026-03-30 11:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_cc1e4df1ea37df0c983432b2e44386c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_d72875fa5cfb22f46a612002f4b95116.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F95%252F3895f7b469f7fac1258475b30ac42764%252Fpa%252FRA80092_b328620fc88a5940f0560d010f928cce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_b328620fc88a5940f0560d010f928cce.jpg not downloaded yet
2026-03-30 11:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_2347df2e7c21b9cf3755ad30a6bb432a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_0510327178f99ca00f06810bd337530a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_96b35f54133cd0a14f3227f513d730a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_10d9b78906a1cc958d1178cedd5c4a54.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738780210>
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d/0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F95%252F3895f7b469f7fac1258475b30ac42764%252Fpa%252FRA80092_d8e9e0ae2d64925c9944676ad1d4574e.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_d8e9e0ae2d64925c9944676ad1d4574e.jpg saved to cache
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384d4450>
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d/0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F95%252F3895f7b469f7fac1258475b30ac42764%252Fpa%252FRA80092_76fad17593aa4046084e1e4b749290d6.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_76fad17593aa4046084e1e4b749290d6.jpg saved to cache
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383d0250>
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d/0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F95%252F3895f7b469f7fac1258475b30ac42764%252Fpa%252FRA80092_cc1e4df1ea37df0c983432b2e44386c8.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_cc1e4df1ea37df0c983432b2e44386c8.jpg saved to cache
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384d5650>
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d/0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F95%252F3895f7b469f7fac1258475b30ac42764%252Fpa%252FRA80092_d72875fa5cfb22f46a612002f4b95116.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_d72875fa5cfb22f46a612002f4b95116.jpg saved to cache
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d
2026-03-30 11:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_f1cd40234c9787be603060384309ae99.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073868e1d0>
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d/0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F95%252F3895f7b469f7fac1258475b30ac42764%252Fpa%252FRA80092_2347df2e7c21b9cf3755ad30a6bb432a.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_2347df2e7c21b9cf3755ad30a6bb432a.jpg saved to cache
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385e85d0>
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d/0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F95%252F3895f7b469f7fac1258475b30ac42764%252Fpa%252FRA80092_0510327178f99ca00f06810bd337530a.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_0510327178f99ca00f06810bd337530a.jpg saved to cache
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738431c50>
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d/0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F95%252F3895f7b469f7fac1258475b30ac42764%252Fpa%252FRA80092_96b35f54133cd0a14f3227f513d730a0.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_96b35f54133cd0a14f3227f513d730a0.jpg saved to cache
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738447850>
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d/0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F95%252F3895f7b469f7fac1258475b30ac42764%252Fpa%252FRA80092_10d9b78906a1cc958d1178cedd5c4a54.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_10d9b78906a1cc958d1178cedd5c4a54.jpg saved to cache
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d
2026-03-30 11:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_b328620fc88a5940f0560d010f928cce.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385bd550>
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d/0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F95%252F3895f7b469f7fac1258475b30ac42764%252Fpa%252FRA80092_f1cd40234c9787be603060384309ae99.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_f1cd40234c9787be603060384309ae99.jpg saved to cache
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738545250>
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d/0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F95%252F3895f7b469f7fac1258475b30ac42764%252Fpa%252FRA80092_b328620fc88a5940f0560d010f928cce.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_b328620fc88a5940f0560d010f928cce.jpg saved to cache
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d
2026-03-30 11:13:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d, skipping ID generation
2026-03-30 11:13:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d with scrape type 1
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d sending to next pipeline
2026-03-30 11:13:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d, identifier: RA80092
2026-03-30 11:13:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d with identifier: RA80092
2026-03-30 11:13:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d with identifier: RA80092
2026-03-30 11:13:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d with identifier: RA80092 to the API
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_b328620fc88a5940f0560d010f928cce.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine': '4.0L',
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:29:05Z',
'fuel_type': 'diesel',
'id': '0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA80092',
'listing': 'auction',
'location': 'FR',
'make': 'Toyota',
'model': 'Land Cruiser',
'odometer': 419624,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d/0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66627,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_76fad17593aa4046084e1e4b749290d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d/0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_d8e9e0ae2d64925c9944676ad1d4574e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d/0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97055,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_cc1e4df1ea37df0c983432b2e44386c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d/0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_d72875fa5cfb22f46a612002f4b95116.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d/0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_0510327178f99ca00f06810bd337530a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d/0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119646,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_2347df2e7c21b9cf3755ad30a6bb432a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d/0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90710,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_96b35f54133cd0a14f3227f513d730a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d/0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80866,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_10d9b78906a1cc958d1178cedd5c4a54.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d/0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79520,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_f1cd40234c9787be603060384309ae99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d/0e37ef24-66d1-5a7e-aa7e-a64a16d15a2d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84612,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/95/3895f7b469f7fac1258475b30ac42764/pa/RA80092_b328620fc88a5940f0560d010f928cce.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '1986-02-26',
'seats_number': 2,
'seller_name': None,
'title': 'Toyota Land Cruiser 4.0 Diesel HJ 60',
'transmission': 'manual',
'trim': 'HJ 60',
'year': 1986}
2026-03-30 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA80092%27 HTTP/1.1" 200 None
2026-03-30 11:13:05 [auto1.fr] INFO: Saving data for RA80092: {'created_time': 1774869185.12811, 'last_price_update_time': 1774869185.12812, 'auction_closing_time': 1774970945.0}
2026-03-30 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RA80092') HTTP/1.1" 204 0
2026-03-30 11:13:05 [scrapy.extensions.logstats] INFO: Crawled 58 pages (at 10 pages/min), scraped 54 items (at 24 items/min)
2026-03-30 11:13:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VA51344/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:11 [auto1.fr] INFO: Channel: 24h | Page: 8 | totalHits: 5553 | hits on page: 40
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: JZ33313
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: CH28631
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: RN18234
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN18234%27 HTTP/1.1" 200 None
2026-03-30 11:13:11 [auto1.fr] INFO: Scrape type for RN18234: 2
2026-03-30 11:13:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b8f2419-9436-51b9-b98c-e3bdac6010ab with identifier: RN18234
2026-03-30 11:13:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b8f2419-9436-51b9-b98c-e3bdac6010ab with scrape type 2
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b8f2419-9436-51b9-b98c-e3bdac6010ab with scrape type 2
2026-03-30 11:13:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9b8f2419-9436-51b9-b98c-e3bdac6010ab, identifier: RN18234
2026-03-30 11:13:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9b8f2419-9436-51b9-b98c-e3bdac6010ab with identifier: RN18234
2026-03-30 11:13:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9b8f2419-9436-51b9-b98c-e3bdac6010ab with identifier: RN18234
2026-03-30 11:13:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9b8f2419-9436-51b9-b98c-e3bdac6010ab with identifier: RN18234 to the API
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:50:27Z',
'fuel_type': 'diesel',
'id': '9b8f2419-9436-51b9-b98c-e3bdac6010ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN18234',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 236429,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-16',
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 1.6 HDi Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2009}
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN18234%27 HTTP/1.1" 200 None
2026-03-30 11:13:11 [auto1.fr] INFO: Saving data for RN18234: {'auction_closing_time': 1774972227.0, 'created_time': 1774278701.948503, 'last_price_update_time': 1774869191.779251}
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RN18234') HTTP/1.1" 204 0
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: YT40335
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT40335%27 HTTP/1.1" 200 None
2026-03-30 11:13:11 [auto1.fr] INFO: Scrape type for YT40335: 1
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: LG92938
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG92938%27 HTTP/1.1" 200 None
2026-03-30 11:13:11 [auto1.fr] INFO: Scrape type for LG92938: 1
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: WA37151
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: TC10044
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC10044%27 HTTP/1.1" 200 None
2026-03-30 11:13:11 [auto1.fr] INFO: Scrape type for TC10044: 1
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: JR90965
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: PS40774
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: KG78882
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: BG48993
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: YH25205
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH25205%27 HTTP/1.1" 200 None
2026-03-30 11:13:11 [auto1.fr] INFO: Scrape type for YH25205: 1
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: SN49390
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: JP51471
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: BU72908
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: AY02939
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: DY99826
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: JZ63677
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: FL10010
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: YL40024
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: MT51030
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: SM29883
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: TL51918
2026-03-30 11:13:11 [auto1.fr] INFO: Found listing with ID: DY24427
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DY24427%27 HTTP/1.1" 200 None
2026-03-30 11:13:11 [auto1.fr] INFO: Scrape type for DY24427: 2
2026-03-30 11:13:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81bdf322-eaa9-52fa-8fe7-28a6196abb12 with identifier: DY24427
2026-03-30 11:13:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81bdf322-eaa9-52fa-8fe7-28a6196abb12 with scrape type 2
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81bdf322-eaa9-52fa-8fe7-28a6196abb12 with scrape type 2
2026-03-30 11:13:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 81bdf322-eaa9-52fa-8fe7-28a6196abb12, identifier: DY24427
2026-03-30 11:13:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 81bdf322-eaa9-52fa-8fe7-28a6196abb12 with identifier: DY24427
2026-03-30 11:13:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 81bdf322-eaa9-52fa-8fe7-28a6196abb12 with identifier: DY24427
2026-03-30 11:13:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 81bdf322-eaa9-52fa-8fe7-28a6196abb12 with identifier: DY24427 to the API
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:22:24Z',
'fuel_type': 'petrol',
'id': '81bdf322-eaa9-52fa-8fe7-28a6196abb12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY24427',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 98898,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-29',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2017}
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DY24427%27 HTTP/1.1" 200 None
2026-03-30 11:13:12 [auto1.fr] INFO: Saving data for DY24427: {'auction_closing_time': 1774970544.0, 'created_time': 1773745865.219185, 'last_price_update_time': 1774869192.337803}
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DY24427') HTTP/1.1" 204 0
2026-03-30 11:13:12 [auto1.fr] INFO: Found listing with ID: GZ98158
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ98158%27 HTTP/1.1" 200 None
2026-03-30 11:13:12 [auto1.fr] INFO: Scrape type for GZ98158: 2
2026-03-30 11:13:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2fff0b5-ba17-5cc7-82be-b8364f71959e with identifier: GZ98158
2026-03-30 11:13:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2fff0b5-ba17-5cc7-82be-b8364f71959e with scrape type 2
2026-03-30 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2fff0b5-ba17-5cc7-82be-b8364f71959e with scrape type 2
2026-03-30 11:13:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c2fff0b5-ba17-5cc7-82be-b8364f71959e, identifier: GZ98158
2026-03-30 11:13:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c2fff0b5-ba17-5cc7-82be-b8364f71959e with identifier: GZ98158
2026-03-30 11:13:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c2fff0b5-ba17-5cc7-82be-b8364f71959e with identifier: GZ98158
2026-03-30 11:13:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c2fff0b5-ba17-5cc7-82be-b8364f71959e with identifier: GZ98158 to the API
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:40:07Z',
'fuel_type': 'diesel',
'id': 'c2fff0b5-ba17-5cc7-82be-b8364f71959e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ98158',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 211120,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-07-20',
'seller_name': None,
'title': 'Kia Sportage 2.0 CRDi EX 4WD',
'transmission': 'manual',
'trim': 'EX 4WD',
'year': 2008}
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ98158%27 HTTP/1.1" 200 None
2026-03-30 11:13:12 [auto1.fr] INFO: Saving data for GZ98158: {'auction_closing_time': 1774971607.0, 'created_time': 1772612782.521036, 'last_price_update_time': 1774869192.89536}
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GZ98158') HTTP/1.1" 204 0
2026-03-30 11:13:12 [auto1.fr] INFO: Found listing with ID: ZY65236
2026-03-30 11:13:12 [auto1.fr] INFO: Found listing with ID: GN48177
2026-03-30 11:13:12 [auto1.fr] INFO: Found listing with ID: LR57312
2026-03-30 11:13:12 [auto1.fr] INFO: Found listing with ID: KY87082
2026-03-30 11:13:12 [auto1.fr] INFO: Found listing with ID: SM05006
2026-03-30 11:13:12 [auto1.fr] INFO: Found listing with ID: FJ63732
2026-03-30 11:13:12 [auto1.fr] INFO: Found listing with ID: TG43184
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG43184%27 HTTP/1.1" 200 None
2026-03-30 11:13:12 [auto1.fr] INFO: Scrape type for TG43184: 2
2026-03-30 11:13:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de5d3d1f-ef68-59c8-9775-f5e51f59ee76 with identifier: TG43184
2026-03-30 11:13:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de5d3d1f-ef68-59c8-9775-f5e51f59ee76 with scrape type 2
2026-03-30 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de5d3d1f-ef68-59c8-9775-f5e51f59ee76 with scrape type 2
2026-03-30 11:13:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: de5d3d1f-ef68-59c8-9775-f5e51f59ee76, identifier: TG43184
2026-03-30 11:13:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: de5d3d1f-ef68-59c8-9775-f5e51f59ee76 with identifier: TG43184
2026-03-30 11:13:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: de5d3d1f-ef68-59c8-9775-f5e51f59ee76 with identifier: TG43184
2026-03-30 11:13:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: de5d3d1f-ef68-59c8-9775-f5e51f59ee76 with identifier: TG43184 to the API
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:00:59Z',
'fuel_type': 'petrol',
'id': 'de5d3d1f-ef68-59c8-9775-f5e51f59ee76',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG43184',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 153235,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-20',
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech Allure Business',
'transmission': 'automatic',
'trim': 'Allure Business',
'year': 2019}
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG43184%27 HTTP/1.1" 200 None
2026-03-30 11:13:13 [auto1.fr] INFO: Saving data for TG43184: {'auction_closing_time': 1774969259.0, 'created_time': 1773058338.091397, 'last_price_update_time': 1774869193.315786}
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TG43184') HTTP/1.1" 204 0
2026-03-30 11:13:13 [auto1.fr] INFO: Found listing with ID: BR95734
2026-03-30 11:13:13 [auto1.fr] INFO: Found listing with ID: NG62303
2026-03-30 11:13:13 [auto1.fr] INFO: Found listing with ID: YW08307
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YW08307%27 HTTP/1.1" 200 None
2026-03-30 11:13:13 [auto1.fr] INFO: Scrape type for YW08307: 1
2026-03-30 11:13:13 [auto1.fr] INFO: Found listing with ID: YU71333
2026-03-30 11:13:13 [auto1.fr] INFO: Found listing with ID: EZ95306
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ95306%27 HTTP/1.1" 200 None
2026-03-30 11:13:13 [auto1.fr] INFO: Scrape type for EZ95306: 1
2026-03-30 11:13:13 [auto1.fr] INFO: Found listing with ID: HV08920
2026-03-30 11:13:13 [auto1.fr] INFO: Found listing with ID: GV11069
2026-03-30 11:13:13 [auto1.fr] INFO: Found listing with ID: GF93568
2026-03-30 11:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VA51344> (referer: https://www.auto1.com/v1/car-details-view/VA51344/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16e29cc4-06fc-5f84-89a2-2d2281f6f7f2 with identifier: VA51344
2026-03-30 11:13:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16e29cc4-06fc-5f84-89a2-2d2281f6f7f2 with scrape type 1
2026-03-30 11:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 16e29cc4-06fc-5f84-89a2-2d2281f6f7f2
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Feb%252F96eb28c7ba3c6873fc4ed4161dbff224%252Fpa%252FVA51344_87548a99ba76bd14637a0fe63f9e89f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_87548a99ba76bd14637a0fe63f9e89f8.jpg already downloaded
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Feb%252F96eb28c7ba3c6873fc4ed4161dbff224%252Fpa%252FVA51344_ac49f773f7b725479964067ca5256526.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_ac49f773f7b725479964067ca5256526.jpg already downloaded
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Feb%252F96eb28c7ba3c6873fc4ed4161dbff224%252Fpa%252FVA51344_6836134e7e75bb18d1414d146de10cd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_6836134e7e75bb18d1414d146de10cd2.jpg already downloaded
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Feb%252F96eb28c7ba3c6873fc4ed4161dbff224%252Fpa%252FVA51344_fdf3f6dca559d8258ededad86f9a1b8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_fdf3f6dca559d8258ededad86f9a1b8c.jpg already downloaded
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Feb%252F96eb28c7ba3c6873fc4ed4161dbff224%252Fpa%252FVA51344_aa041516a58d4f8ef03921dcb7f0e147.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_aa041516a58d4f8ef03921dcb7f0e147.jpg already downloaded
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Feb%252F96eb28c7ba3c6873fc4ed4161dbff224%252Fpa%252FVA51344_fd15e50b7d30f7638df578148a258552.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_fd15e50b7d30f7638df578148a258552.jpg already downloaded
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Feb%252F96eb28c7ba3c6873fc4ed4161dbff224%252Fpa%252FVA51344_c17f5e0cbb96890b8c8dae79878e3435.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_c17f5e0cbb96890b8c8dae79878e3435.jpg already downloaded
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Feb%252F96eb28c7ba3c6873fc4ed4161dbff224%252Fpa%252FVA51344_0b01ba36ed18646b7b1540ee241c4a95.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_0b01ba36ed18646b7b1540ee241c4a95.jpg already downloaded
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Feb%252F96eb28c7ba3c6873fc4ed4161dbff224%252Fpa%252FVA51344_c1882fd13a261ad27383e458d817241e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_c1882fd13a261ad27383e458d817241e.jpg already downloaded
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Feb%252F96eb28c7ba3c6873fc4ed4161dbff224%252Fpa%252FVA51344_d4c624a60ac5b3f017c13c2951babb54.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_d4c624a60ac5b3f017c13c2951babb54.jpg already downloaded
2026-03-30 11:13:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 16e29cc4-06fc-5f84-89a2-2d2281f6f7f2, identifier: VA51344
2026-03-30 11:13:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 16e29cc4-06fc-5f84-89a2-2d2281f6f7f2 with identifier: VA51344
2026-03-30 11:13:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 16e29cc4-06fc-5f84-89a2-2d2281f6f7f2 with identifier: VA51344
2026-03-30 11:13:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 16e29cc4-06fc-5f84-89a2-2d2281f6f7f2 with identifier: VA51344 to the API
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VA51344>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:09:42Z',
'fuel_type': 'diesel',
'id': '16e29cc4-06fc-5f84-89a2-2d2281f6f7f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA51344',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 105978,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_87548a99ba76bd14637a0fe63f9e89f8.jpg',
'https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_ac49f773f7b725479964067ca5256526.jpg',
'https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_6836134e7e75bb18d1414d146de10cd2.jpg',
'https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_fdf3f6dca559d8258ededad86f9a1b8c.jpg',
'https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_aa041516a58d4f8ef03921dcb7f0e147.jpg',
'https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_fd15e50b7d30f7638df578148a258552.jpg',
'https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_c17f5e0cbb96890b8c8dae79878e3435.jpg',
'https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_0b01ba36ed18646b7b1540ee241c4a95.jpg',
'https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_c1882fd13a261ad27383e458d817241e.jpg',
'https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_d4c624a60ac5b3f017c13c2951babb54.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16e29cc4-06fc-5f84-89a2-2d2281f6f7f2/16e29cc4-06fc-5f84-89a2-2d2281f6f7f2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67676,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_87548a99ba76bd14637a0fe63f9e89f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16e29cc4-06fc-5f84-89a2-2d2281f6f7f2/16e29cc4-06fc-5f84-89a2-2d2281f6f7f2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75366,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_ac49f773f7b725479964067ca5256526.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16e29cc4-06fc-5f84-89a2-2d2281f6f7f2/16e29cc4-06fc-5f84-89a2-2d2281f6f7f2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64870,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_6836134e7e75bb18d1414d146de10cd2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16e29cc4-06fc-5f84-89a2-2d2281f6f7f2/16e29cc4-06fc-5f84-89a2-2d2281f6f7f2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55864,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_fdf3f6dca559d8258ededad86f9a1b8c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16e29cc4-06fc-5f84-89a2-2d2281f6f7f2/16e29cc4-06fc-5f84-89a2-2d2281f6f7f2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52429,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_aa041516a58d4f8ef03921dcb7f0e147.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16e29cc4-06fc-5f84-89a2-2d2281f6f7f2/16e29cc4-06fc-5f84-89a2-2d2281f6f7f2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_fd15e50b7d30f7638df578148a258552.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16e29cc4-06fc-5f84-89a2-2d2281f6f7f2/16e29cc4-06fc-5f84-89a2-2d2281f6f7f2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59330,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_c17f5e0cbb96890b8c8dae79878e3435.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16e29cc4-06fc-5f84-89a2-2d2281f6f7f2/16e29cc4-06fc-5f84-89a2-2d2281f6f7f2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74601,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_0b01ba36ed18646b7b1540ee241c4a95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16e29cc4-06fc-5f84-89a2-2d2281f6f7f2/16e29cc4-06fc-5f84-89a2-2d2281f6f7f2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74768,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_c1882fd13a261ad27383e458d817241e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16e29cc4-06fc-5f84-89a2-2d2281f6f7f2/16e29cc4-06fc-5f84-89a2-2d2281f6f7f2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/eb/96eb28c7ba3c6873fc4ed4161dbff224/pa/VA51344_d4c624a60ac5b3f017c13c2951babb54.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-12-11',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Td4 SE',
'transmission': 'manual',
'trim': 'SE',
'year': 2015}
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VA51344%27 HTTP/1.1" 200 None
2026-03-30 11:13:20 [auto1.fr] INFO: Saving data for VA51344: {'created_time': 1774869200.179158, 'last_price_update_time': 1774869200.179169, 'auction_closing_time': 1774969782.0}
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VA51344') HTTP/1.1" 204 0
2026-03-30 11:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NT04558> (referer: https://www.auto1.com/v1/car-details-view/NT04558/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8e50276-f071-5662-8917-78111c99907e with identifier: NT04558
2026-03-30 11:13:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8e50276-f071-5662-8917-78111c99907e with scrape type 1
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8e50276-f071-5662-8917-78111c99907e
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F79%252F9f792878ec3aaf7b0fd8092141f42b35%252Fpa%252FNT04558_1722b3e5ca7380bfd066c11e18ec1708.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_1722b3e5ca7380bfd066c11e18ec1708.jpg already downloaded
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F79%252F9f792878ec3aaf7b0fd8092141f42b35%252Fpa%252FNT04558_28394d282fb03863a7167bcaefbf6b80.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_28394d282fb03863a7167bcaefbf6b80.jpg already downloaded
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F79%252F9f792878ec3aaf7b0fd8092141f42b35%252Fpa%252FNT04558_b5ac9ec51979e99b635920c990e3fccc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_b5ac9ec51979e99b635920c990e3fccc.jpg already downloaded
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F79%252F9f792878ec3aaf7b0fd8092141f42b35%252Fpa%252FNT04558_6904f6138e8434429db2728a927538d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_6904f6138e8434429db2728a927538d7.jpg already downloaded
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F79%252F9f792878ec3aaf7b0fd8092141f42b35%252Fpa%252FNT04558_02a7d3b312be9b5c6b3080a68773ef94.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_02a7d3b312be9b5c6b3080a68773ef94.jpg already downloaded
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F79%252F9f792878ec3aaf7b0fd8092141f42b35%252Fpa%252FNT04558_1a3312e196c2bcd7f1cb89d702f85712.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_1a3312e196c2bcd7f1cb89d702f85712.jpg already downloaded
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F79%252F9f792878ec3aaf7b0fd8092141f42b35%252Fpa%252FNT04558_e1c6fdaa578d4e1f71907d0edb60a7c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_e1c6fdaa578d4e1f71907d0edb60a7c2.jpg already downloaded
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F79%252F9f792878ec3aaf7b0fd8092141f42b35%252Fpa%252FNT04558_eaafbf7da13608a23841f1f978f1c18f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_eaafbf7da13608a23841f1f978f1c18f.jpg already downloaded
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F79%252F9f792878ec3aaf7b0fd8092141f42b35%252Fpa%252FNT04558_138a6a9a960ed01cd8894bf02d577b22.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_138a6a9a960ed01cd8894bf02d577b22.jpg already downloaded
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F79%252F9f792878ec3aaf7b0fd8092141f42b35%252Fpa%252FNT04558_bdfc9d90cad199d1701b58516bd34989.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_bdfc9d90cad199d1701b58516bd34989.jpg already downloaded
2026-03-30 11:13:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d8e50276-f071-5662-8917-78111c99907e, identifier: NT04558
2026-03-30 11:13:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d8e50276-f071-5662-8917-78111c99907e with identifier: NT04558
2026-03-30 11:13:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d8e50276-f071-5662-8917-78111c99907e with identifier: NT04558
2026-03-30 11:13:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d8e50276-f071-5662-8917-78111c99907e with identifier: NT04558 to the API
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NT04558>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 204,
'expiration_date': '2026-03-31T15:31:30Z',
'fuel_type': 'diesel',
'id': 'd8e50276-f071-5662-8917-78111c99907e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT04558',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Audi',
'model': 'A6',
'odometer': 264032,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_1722b3e5ca7380bfd066c11e18ec1708.jpg',
'https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_28394d282fb03863a7167bcaefbf6b80.jpg',
'https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_b5ac9ec51979e99b635920c990e3fccc.jpg',
'https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_6904f6138e8434429db2728a927538d7.jpg',
'https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_02a7d3b312be9b5c6b3080a68773ef94.jpg',
'https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_1a3312e196c2bcd7f1cb89d702f85712.jpg',
'https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_e1c6fdaa578d4e1f71907d0edb60a7c2.jpg',
'https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_eaafbf7da13608a23841f1f978f1c18f.jpg',
'https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_138a6a9a960ed01cd8894bf02d577b22.jpg',
'https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_bdfc9d90cad199d1701b58516bd34989.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e50276-f071-5662-8917-78111c99907e/d8e50276-f071-5662-8917-78111c99907e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_1722b3e5ca7380bfd066c11e18ec1708.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e50276-f071-5662-8917-78111c99907e/d8e50276-f071-5662-8917-78111c99907e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_28394d282fb03863a7167bcaefbf6b80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e50276-f071-5662-8917-78111c99907e/d8e50276-f071-5662-8917-78111c99907e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67867,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_b5ac9ec51979e99b635920c990e3fccc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e50276-f071-5662-8917-78111c99907e/d8e50276-f071-5662-8917-78111c99907e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60480,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_6904f6138e8434429db2728a927538d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e50276-f071-5662-8917-78111c99907e/d8e50276-f071-5662-8917-78111c99907e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_02a7d3b312be9b5c6b3080a68773ef94.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e50276-f071-5662-8917-78111c99907e/d8e50276-f071-5662-8917-78111c99907e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70191,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_1a3312e196c2bcd7f1cb89d702f85712.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e50276-f071-5662-8917-78111c99907e/d8e50276-f071-5662-8917-78111c99907e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52790,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_e1c6fdaa578d4e1f71907d0edb60a7c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e50276-f071-5662-8917-78111c99907e/d8e50276-f071-5662-8917-78111c99907e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76185,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_eaafbf7da13608a23841f1f978f1c18f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e50276-f071-5662-8917-78111c99907e/d8e50276-f071-5662-8917-78111c99907e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70067,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_138a6a9a960ed01cd8894bf02d577b22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e50276-f071-5662-8917-78111c99907e/d8e50276-f071-5662-8917-78111c99907e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1873730,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/79/9f792878ec3aaf7b0fd8092141f42b35/pa/NT04558_bdfc9d90cad199d1701b58516bd34989.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-18',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 40 TDI Mild-Hybrid Avus',
'transmission': 'automatic',
'trim': 'Avus',
'year': 2018}
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT04558%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [auto1.fr] INFO: Saving data for NT04558: {'created_time': 1774869208.875021, 'last_price_update_time': 1774869208.875031, 'auction_closing_time': 1774971090.0}
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NT04558') HTTP/1.1" 204 0
2026-03-30 11:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YT40335/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG92938/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TC10044/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH25205/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YW08307/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:05 [scrapy.extensions.logstats] INFO: Crawled 67 pages (at 9 pages/min), scraped 60 items (at 6 items/min)
2026-03-30 11:14:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:24 [auto1.fr] INFO: Channel: 24h | Page: 9 | totalHits: 5557 | hits on page: 40
2026-03-30 11:14:24 [auto1.fr] INFO: Found listing with ID: EZ95306
2026-03-30 11:14:24 [auto1.fr] INFO: Found listing with ID: HV08920
2026-03-30 11:14:24 [auto1.fr] INFO: Found listing with ID: GV11069
2026-03-30 11:14:24 [auto1.fr] INFO: Found listing with ID: GF93568
2026-03-30 11:14:24 [auto1.fr] INFO: Found listing with ID: CE47348
2026-03-30 11:14:24 [auto1.fr] INFO: Found listing with ID: SC47506
2026-03-30 11:14:24 [auto1.fr] INFO: Found listing with ID: FA55776
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA55776%27 HTTP/1.1" 200 None
2026-03-30 11:14:24 [auto1.fr] INFO: Scrape type for FA55776: 2
2026-03-30 11:14:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69bd8e4e-000f-5267-95dd-ce027daccaed with identifier: FA55776
2026-03-30 11:14:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69bd8e4e-000f-5267-95dd-ce027daccaed with scrape type 2
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69bd8e4e-000f-5267-95dd-ce027daccaed with scrape type 2
2026-03-30 11:14:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 69bd8e4e-000f-5267-95dd-ce027daccaed, identifier: FA55776
2026-03-30 11:14:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 69bd8e4e-000f-5267-95dd-ce027daccaed with identifier: FA55776
2026-03-30 11:14:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 69bd8e4e-000f-5267-95dd-ce027daccaed with identifier: FA55776
2026-03-30 11:14:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 69bd8e4e-000f-5267-95dd-ce027daccaed with identifier: FA55776 to the API
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 58,
'expiration_date': '2026-03-31T15:44:54Z',
'fuel_type': 'petrol',
'id': '69bd8e4e-000f-5267-95dd-ce027daccaed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA55776',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 175054,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-20',
'seller_name': None,
'title': 'Renault Clio 1.2 Campus Authentique',
'transmission': 'manual',
'trim': 'Campus Authentique',
'year': 2007}
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA55776%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [auto1.fr] INFO: Saving data for FA55776: {'auction_closing_time': 1774971894.0, 'created_time': 1774298392.445939, 'last_price_update_time': 1774869265.425984}
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FA55776') HTTP/1.1" 204 0
2026-03-30 11:14:25 [auto1.fr] INFO: Found listing with ID: RJ76526
2026-03-30 11:14:25 [auto1.fr] INFO: Found listing with ID: PX29564
2026-03-30 11:14:25 [auto1.fr] INFO: Found listing with ID: BP52149
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP52149%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [auto1.fr] INFO: Scrape type for BP52149: 2
2026-03-30 11:14:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1511a4ca-47f1-5f7c-86b4-9a28303b8e30 with identifier: BP52149
2026-03-30 11:14:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1511a4ca-47f1-5f7c-86b4-9a28303b8e30 with scrape type 2
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1511a4ca-47f1-5f7c-86b4-9a28303b8e30 with scrape type 2
2026-03-30 11:14:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1511a4ca-47f1-5f7c-86b4-9a28303b8e30, identifier: BP52149
2026-03-30 11:14:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1511a4ca-47f1-5f7c-86b4-9a28303b8e30 with identifier: BP52149
2026-03-30 11:14:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1511a4ca-47f1-5f7c-86b4-9a28303b8e30 with identifier: BP52149
2026-03-30 11:14:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1511a4ca-47f1-5f7c-86b4-9a28303b8e30 with identifier: BP52149 to the API
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:57:06Z',
'fuel_type': 'diesel',
'id': '1511a4ca-47f1-5f7c-86b4-9a28303b8e30',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP52149',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 312842,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-28',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2015}
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP52149%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [auto1.fr] INFO: Saving data for BP52149: {'auction_closing_time': 1774972626.0, 'created_time': 1773745621.101253, 'last_price_update_time': 1774869265.877859}
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BP52149') HTTP/1.1" 204 0
2026-03-30 11:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EZ95306/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:25 [auto1.fr] INFO: Found listing with ID: SR29633
2026-03-30 11:14:25 [auto1.fr] INFO: Found listing with ID: ER22482
2026-03-30 11:14:25 [auto1.fr] INFO: Found listing with ID: TW16745
2026-03-30 11:14:25 [auto1.fr] INFO: Found listing with ID: VN64150
2026-03-30 11:14:25 [auto1.fr] INFO: Found listing with ID: FK36448
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK36448%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [auto1.fr] INFO: Scrape type for FK36448: 2
2026-03-30 11:14:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0054f261-a2e9-563a-8551-33ac27d91e66 with identifier: FK36448
2026-03-30 11:14:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0054f261-a2e9-563a-8551-33ac27d91e66 with scrape type 2
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0054f261-a2e9-563a-8551-33ac27d91e66 with scrape type 2
2026-03-30 11:14:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0054f261-a2e9-563a-8551-33ac27d91e66, identifier: FK36448
2026-03-30 11:14:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0054f261-a2e9-563a-8551-33ac27d91e66 with identifier: FK36448
2026-03-30 11:14:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0054f261-a2e9-563a-8551-33ac27d91e66 with identifier: FK36448
2026-03-30 11:14:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0054f261-a2e9-563a-8551-33ac27d91e66 with identifier: FK36448 to the API
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:05:38Z',
'fuel_type': 'petrol',
'id': '0054f261-a2e9-563a-8551-33ac27d91e66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK36448',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 116557,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-28',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2017}
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK36448%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.fr] INFO: Saving data for FK36448: {'auction_closing_time': 1774969538.0, 'created_time': 1772886664.672959, 'last_price_update_time': 1774869266.342033}
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FK36448') HTTP/1.1" 204 0
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: FS93369
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS93369%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.fr] INFO: Scrape type for FS93369: 1
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: UB37186
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: TR84613
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR84613%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.fr] INFO: Scrape type for TR84613: 2
2026-03-30 11:14:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 831b96ac-cae9-5b60-ad10-25585729abd1 with identifier: TR84613
2026-03-30 11:14:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 831b96ac-cae9-5b60-ad10-25585729abd1 with scrape type 2
2026-03-30 11:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 831b96ac-cae9-5b60-ad10-25585729abd1 with scrape type 2
2026-03-30 11:14:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 831b96ac-cae9-5b60-ad10-25585729abd1, identifier: TR84613
2026-03-30 11:14:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 831b96ac-cae9-5b60-ad10-25585729abd1 with identifier: TR84613
2026-03-30 11:14:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 831b96ac-cae9-5b60-ad10-25585729abd1 with identifier: TR84613
2026-03-30 11:14:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 831b96ac-cae9-5b60-ad10-25585729abd1 with identifier: TR84613 to the API
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:19:30Z',
'fuel_type': 'petrol',
'id': '831b96ac-cae9-5b60-ad10-25585729abd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR84613',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 143733,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-27',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2012}
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR84613%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.fr] INFO: Saving data for TR84613: {'auction_closing_time': 1774970370.0, 'created_time': 1773745758.757032, 'last_price_update_time': 1774869266.905504}
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TR84613') HTTP/1.1" 204 0
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: VX34217
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: UC60343
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: DF41129
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DF41129%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.fr] INFO: Scrape type for DF41129: 1
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: CD49178
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: AK18752
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: CC48181
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: RG71541
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: PW84769
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: UU20581
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: NS62449
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: SU26545
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU26545%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.fr] INFO: Scrape type for SU26545: 1
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: ZH11864
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: WW50830
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: UW11385
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: EY85679
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: GE12087
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: HR25538
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: PB55961
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB55961%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.fr] INFO: Scrape type for PB55961: 1
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: AZ61260
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: AL31248
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: HB67890
2026-03-30 11:14:26 [auto1.fr] INFO: Found listing with ID: CA62859
2026-03-30 11:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YT40335> (referer: https://www.auto1.com/v1/car-details-view/YT40335/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79a8576d-8aa3-5c6b-b417-fa4ceb4310cd with identifier: YT40335
2026-03-30 11:14:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79a8576d-8aa3-5c6b-b417-fa4ceb4310cd with scrape type 1
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 79a8576d-8aa3-5c6b-b417-fa4ceb4310cd
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F9a%252Fbc9a6ea42282d08f0b4e399224c52733%252Fpa%252FYT40335_148f5bcdd74c2bdd649c4605673982a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/9a/bc9a6ea42282d08f0b4e399224c52733/pa/YT40335_148f5bcdd74c2bdd649c4605673982a3.jpg already downloaded
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F9a%252Fbc9a6ea42282d08f0b4e399224c52733%252Fpa%252FYT40335_4ee28fe5887b77fd8e082868b6fb29aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/9a/bc9a6ea42282d08f0b4e399224c52733/pa/YT40335_4ee28fe5887b77fd8e082868b6fb29aa.jpg already downloaded
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F9a%252Fbc9a6ea42282d08f0b4e399224c52733%252Fpa%252FYT40335_f8e31c16abca87109324cb18b9568bbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/9a/bc9a6ea42282d08f0b4e399224c52733/pa/YT40335_f8e31c16abca87109324cb18b9568bbc.jpg already downloaded
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F9a%252Fbc9a6ea42282d08f0b4e399224c52733%252Fpa%252FYT40335_71a8d4e2175254d263f1737b2ebde0e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/9a/bc9a6ea42282d08f0b4e399224c52733/pa/YT40335_71a8d4e2175254d263f1737b2ebde0e6.jpg already downloaded
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F9a%252Fbc9a6ea42282d08f0b4e399224c52733%252Fpa%252FYT40335_915b3a7327bfd1de9fd8a827174adef8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/9a/bc9a6ea42282d08f0b4e399224c52733/pa/YT40335_915b3a7327bfd1de9fd8a827174adef8.jpg already downloaded
2026-03-30 11:14:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 79a8576d-8aa3-5c6b-b417-fa4ceb4310cd, identifier: YT40335
2026-03-30 11:14:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 79a8576d-8aa3-5c6b-b417-fa4ceb4310cd with identifier: YT40335
2026-03-30 11:14:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 79a8576d-8aa3-5c6b-b417-fa4ceb4310cd with identifier: YT40335
2026-03-30 11:14:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 79a8576d-8aa3-5c6b-b417-fa4ceb4310cd with identifier: YT40335 to the API
2026-03-30 11:14:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YT40335>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.1L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:07:24Z',
'fuel_type': 'petrol',
'id': '79a8576d-8aa3-5c6b-b417-fa4ceb4310cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT40335',
'listing': 'auction',
'location': 'Perpignan',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 132313,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/imgbc/9a/bc9a6ea42282d08f0b4e399224c52733/pa/YT40335_148f5bcdd74c2bdd649c4605673982a3.jpg',
'https://img-pa.auto1.com/imgbc/9a/bc9a6ea42282d08f0b4e399224c52733/pa/YT40335_4ee28fe5887b77fd8e082868b6fb29aa.jpg',
'https://img-pa.auto1.com/imgbc/9a/bc9a6ea42282d08f0b4e399224c52733/pa/YT40335_f8e31c16abca87109324cb18b9568bbc.jpg',
'https://img-pa.auto1.com/imgbc/9a/bc9a6ea42282d08f0b4e399224c52733/pa/YT40335_71a8d4e2175254d263f1737b2ebde0e6.jpg',
'https://img-pa.auto1.com/imgbc/9a/bc9a6ea42282d08f0b4e399224c52733/pa/YT40335_915b3a7327bfd1de9fd8a827174adef8.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a8576d-8aa3-5c6b-b417-fa4ceb4310cd/79a8576d-8aa3-5c6b-b417-fa4ceb4310cd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81608,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/9a/bc9a6ea42282d08f0b4e399224c52733/pa/YT40335_148f5bcdd74c2bdd649c4605673982a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a8576d-8aa3-5c6b-b417-fa4ceb4310cd/79a8576d-8aa3-5c6b-b417-fa4ceb4310cd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101599,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/9a/bc9a6ea42282d08f0b4e399224c52733/pa/YT40335_4ee28fe5887b77fd8e082868b6fb29aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a8576d-8aa3-5c6b-b417-fa4ceb4310cd/79a8576d-8aa3-5c6b-b417-fa4ceb4310cd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81661,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/9a/bc9a6ea42282d08f0b4e399224c52733/pa/YT40335_f8e31c16abca87109324cb18b9568bbc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a8576d-8aa3-5c6b-b417-fa4ceb4310cd/79a8576d-8aa3-5c6b-b417-fa4ceb4310cd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66926,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/9a/bc9a6ea42282d08f0b4e399224c52733/pa/YT40335_71a8d4e2175254d263f1737b2ebde0e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a8576d-8aa3-5c6b-b417-fa4ceb4310cd/79a8576d-8aa3-5c6b-b417-fa4ceb4310cd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 127939,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/9a/bc9a6ea42282d08f0b4e399224c52733/pa/YT40335_915b3a7327bfd1de9fd8a827174adef8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 1.2',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-30 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT40335%27 HTTP/1.1" 200 None
2026-03-30 11:14:28 [auto1.fr] INFO: Saving data for YT40335: {'created_time': 1774869268.282219, 'last_price_update_time': 1774869268.28223, 'auction_closing_time': 1774969644.0}
2026-03-30 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YT40335') HTTP/1.1" 204 0
2026-03-30 11:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TC10044> (referer: https://www.auto1.com/v1/car-details-view/TC10044/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89d6589e-a3a2-5c9d-b2d7-314207a184fb with identifier: TC10044
2026-03-30 11:14:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89d6589e-a3a2-5c9d-b2d7-314207a184fb with scrape type 1
2026-03-30 11:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89d6589e-a3a2-5c9d-b2d7-314207a184fb
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe5%252F3ee59b61c723bd38464c072ae6129c79%252Fpa%252FTC10044_01f4394ee0954225baf3fe18886e773f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_01f4394ee0954225baf3fe18886e773f.jpg already downloaded
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe5%252F3ee59b61c723bd38464c072ae6129c79%252Fpa%252FTC10044_938e07a55c449c96fdfdf3e117c55353.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_938e07a55c449c96fdfdf3e117c55353.jpg already downloaded
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe5%252F3ee59b61c723bd38464c072ae6129c79%252Fpa%252FTC10044_cf9060683349e79f197fe641789d3565.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_cf9060683349e79f197fe641789d3565.jpg already downloaded
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe5%252F3ee59b61c723bd38464c072ae6129c79%252Fpa%252FTC10044_6de4375941a84cad55d24dcfa359bb6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_6de4375941a84cad55d24dcfa359bb6c.jpg already downloaded
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe5%252F3ee59b61c723bd38464c072ae6129c79%252Fpa%252FTC10044_502836751444b147c9cdc9288ff4834e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_502836751444b147c9cdc9288ff4834e.jpg already downloaded
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe5%252F3ee59b61c723bd38464c072ae6129c79%252Fpa%252FTC10044_ee8b961e8f81ef35892cadd506fcfae5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_ee8b961e8f81ef35892cadd506fcfae5.jpg already downloaded
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe5%252F3ee59b61c723bd38464c072ae6129c79%252Fpa%252FTC10044_125b1570fb5e1f6a17700a23c61022ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_125b1570fb5e1f6a17700a23c61022ba.jpg already downloaded
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe5%252F3ee59b61c723bd38464c072ae6129c79%252Fpa%252FTC10044_cb126eae694ad48b1a109d24bc0d2b21.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_cb126eae694ad48b1a109d24bc0d2b21.jpg already downloaded
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe5%252F3ee59b61c723bd38464c072ae6129c79%252Fpa%252FTC10044_fefd5c41a1468bb2f6b8e1d100f3ea63.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_fefd5c41a1468bb2f6b8e1d100f3ea63.jpg already downloaded
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fe5%252F3ee59b61c723bd38464c072ae6129c79%252Fpa%252FTC10044_f9e6e958055aa070ed893bc32ee126b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_f9e6e958055aa070ed893bc32ee126b9.jpg already downloaded
2026-03-30 11:14:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 89d6589e-a3a2-5c9d-b2d7-314207a184fb, identifier: TC10044
2026-03-30 11:14:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 89d6589e-a3a2-5c9d-b2d7-314207a184fb with identifier: TC10044
2026-03-30 11:14:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 89d6589e-a3a2-5c9d-b2d7-314207a184fb with identifier: TC10044
2026-03-30 11:14:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 89d6589e-a3a2-5c9d-b2d7-314207a184fb with identifier: TC10044 to the API
2026-03-30 11:14:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TC10044>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:56:31Z',
'fuel_type': 'petrol',
'id': '89d6589e-a3a2-5c9d-b2d7-314207a184fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC10044',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Peugeot',
'model': '3008',
'odometer': 130223,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 19,
'photo_urls': ['https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_01f4394ee0954225baf3fe18886e773f.jpg',
'https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_938e07a55c449c96fdfdf3e117c55353.jpg',
'https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_cf9060683349e79f197fe641789d3565.jpg',
'https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_6de4375941a84cad55d24dcfa359bb6c.jpg',
'https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_502836751444b147c9cdc9288ff4834e.jpg',
'https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_ee8b961e8f81ef35892cadd506fcfae5.jpg',
'https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_125b1570fb5e1f6a17700a23c61022ba.jpg',
'https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_cb126eae694ad48b1a109d24bc0d2b21.jpg',
'https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_fefd5c41a1468bb2f6b8e1d100f3ea63.jpg',
'https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_f9e6e958055aa070ed893bc32ee126b9.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89d6589e-a3a2-5c9d-b2d7-314207a184fb/89d6589e-a3a2-5c9d-b2d7-314207a184fb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 130638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_01f4394ee0954225baf3fe18886e773f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89d6589e-a3a2-5c9d-b2d7-314207a184fb/89d6589e-a3a2-5c9d-b2d7-314207a184fb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_938e07a55c449c96fdfdf3e117c55353.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89d6589e-a3a2-5c9d-b2d7-314207a184fb/89d6589e-a3a2-5c9d-b2d7-314207a184fb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_cf9060683349e79f197fe641789d3565.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89d6589e-a3a2-5c9d-b2d7-314207a184fb/89d6589e-a3a2-5c9d-b2d7-314207a184fb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106406,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_6de4375941a84cad55d24dcfa359bb6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89d6589e-a3a2-5c9d-b2d7-314207a184fb/89d6589e-a3a2-5c9d-b2d7-314207a184fb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_502836751444b147c9cdc9288ff4834e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89d6589e-a3a2-5c9d-b2d7-314207a184fb/89d6589e-a3a2-5c9d-b2d7-314207a184fb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137914,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_ee8b961e8f81ef35892cadd506fcfae5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89d6589e-a3a2-5c9d-b2d7-314207a184fb/89d6589e-a3a2-5c9d-b2d7-314207a184fb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134954,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_125b1570fb5e1f6a17700a23c61022ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89d6589e-a3a2-5c9d-b2d7-314207a184fb/89d6589e-a3a2-5c9d-b2d7-314207a184fb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111248,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_cb126eae694ad48b1a109d24bc0d2b21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89d6589e-a3a2-5c9d-b2d7-314207a184fb/89d6589e-a3a2-5c9d-b2d7-314207a184fb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60285,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_fefd5c41a1468bb2f6b8e1d100f3ea63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89d6589e-a3a2-5c9d-b2d7-314207a184fb/89d6589e-a3a2-5c9d-b2d7-314207a184fb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78120,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e5/3ee59b61c723bd38464c072ae6129c79/pa/TC10044_f9e6e958055aa070ed893bc32ee126b9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-23',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2018}
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC10044%27 HTTP/1.1" 200 None
2026-03-30 11:14:48 [auto1.fr] INFO: Saving data for TC10044: {'created_time': 1774869288.150074, 'last_price_update_time': 1774869288.150084, 'auction_closing_time': 1774972591.0}
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TC10044') HTTP/1.1" 204 0
2026-03-30 11:14:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH25205> (referer: https://www.auto1.com/v1/car-details-view/YH25205/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08e2500f-128d-5cf7-82c3-3a4bb266b6aa with identifier: YH25205
2026-03-30 11:14:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08e2500f-128d-5cf7-82c3-3a4bb266b6aa with scrape type 1
2026-03-30 11:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08e2500f-128d-5cf7-82c3-3a4bb266b6aa
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F64%252Fbb6418cf597973190f9eee4d7d453051%252Fpa%252FYH25205_53344751651eca616c5e9ae7dc65e874.png%27 HTTP/1.1" 200 None
2026-03-30 11:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_53344751651eca616c5e9ae7dc65e874.png not downloaded yet
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F64%252Fbb6418cf597973190f9eee4d7d453051%252Fpa%252FYH25205_eb2ddb7f48a79bebf085614eec89178c.png%27 HTTP/1.1" 200 None
2026-03-30 11:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_eb2ddb7f48a79bebf085614eec89178c.png not downloaded yet
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F64%252Fbb6418cf597973190f9eee4d7d453051%252Fpa%252FYH25205_29a6309c54768947fabb4cc23b5f9cf6.png%27 HTTP/1.1" 200 None
2026-03-30 11:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_29a6309c54768947fabb4cc23b5f9cf6.png not downloaded yet
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F64%252Fbb6418cf597973190f9eee4d7d453051%252Fpa%252FYH25205_f16b1307e2ddfecd3bbbb56e55f156d8.png%27 HTTP/1.1" 200 None
2026-03-30 11:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_f16b1307e2ddfecd3bbbb56e55f156d8.png not downloaded yet
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F64%252Fbb6418cf597973190f9eee4d7d453051%252Fpa%252FYH25205_700e0844faf1aa084203cf4fb5d6614a.png%27 HTTP/1.1" 200 None
2026-03-30 11:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_700e0844faf1aa084203cf4fb5d6614a.png not downloaded yet
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F64%252Fbb6418cf597973190f9eee4d7d453051%252Fpa%252FYH25205_051919be8fe329f5c0137dbc4d379843.png%27 HTTP/1.1" 200 None
2026-03-30 11:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_051919be8fe329f5c0137dbc4d379843.png not downloaded yet
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F64%252Fbb6418cf597973190f9eee4d7d453051%252Fpa%252FYH25205_0b85945b6a3757c1f543f9c217df3f82.png%27 HTTP/1.1" 200 None
2026-03-30 11:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_0b85945b6a3757c1f543f9c217df3f82.png not downloaded yet
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F64%252Fbb6418cf597973190f9eee4d7d453051%252Fpa%252FYH25205_232229d5904d5518e50c41bb0b882b94.png%27 HTTP/1.1" 200 None
2026-03-30 11:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_232229d5904d5518e50c41bb0b882b94.png not downloaded yet
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F64%252Fbb6418cf597973190f9eee4d7d453051%252Fpa%252FYH25205_4f1ca6019d146e78bd4a8f4727589cc0.png%27 HTTP/1.1" 200 None
2026-03-30 11:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_4f1ca6019d146e78bd4a8f4727589cc0.png not downloaded yet
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F64%252Fbb6418cf597973190f9eee4d7d453051%252Fpa%252FYH25205_8ad13ded031676e07751df4e535b1715.png%27 HTTP/1.1" 200 None
2026-03-30 11:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_8ad13ded031676e07751df4e535b1715.png not downloaded yet
2026-03-30 11:14:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_eb2ddb7f48a79bebf085614eec89178c.png> (referer: https://www.auto1.com/)
2026-03-30 11:14:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_53344751651eca616c5e9ae7dc65e874.png> (referer: https://www.auto1.com/)
2026-03-30 11:14:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_8ad13ded031676e07751df4e535b1715.png> (referer: https://www.auto1.com/)
2026-03-30 11:14:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_4f1ca6019d146e78bd4a8f4727589cc0.png> (referer: https://www.auto1.com/)
2026-03-30 11:14:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_232229d5904d5518e50c41bb0b882b94.png> (referer: https://www.auto1.com/)
2026-03-30 11:14:49 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:14:49 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 11:14:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385bcb10>
2026-03-30 11:14:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08e2500f-128d-5cf7-82c3-3a4bb266b6aa/08e2500f-128d-5cf7-82c3-3a4bb266b6aa_image_1.png HTTP/1.1" 201 0
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F64%252Fbb6418cf597973190f9eee4d7d453051%252Fpa%252FYH25205_eb2ddb7f48a79bebf085614eec89178c.png') HTTP/1.1" 204 0
2026-03-30 11:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_eb2ddb7f48a79bebf085614eec89178c.png saved to cache
2026-03-30 11:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08e2500f-128d-5cf7-82c3-3a4bb266b6aa
2026-03-30 11:14:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_0b85945b6a3757c1f543f9c217df3f82.png> (referer: https://www.auto1.com/)
2026-03-30 11:14:49 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:14:49 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 11:14:49 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 11:14:49 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 11:14:49 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 11:14:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073871f7d0>
2026-03-30 11:14:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08e2500f-128d-5cf7-82c3-3a4bb266b6aa/08e2500f-128d-5cf7-82c3-3a4bb266b6aa_image_0.png HTTP/1.1" 201 0
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F64%252Fbb6418cf597973190f9eee4d7d453051%252Fpa%252FYH25205_53344751651eca616c5e9ae7dc65e874.png') HTTP/1.1" 204 0
2026-03-30 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_53344751651eca616c5e9ae7dc65e874.png saved to cache
2026-03-30 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08e2500f-128d-5cf7-82c3-3a4bb266b6aa
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073845bf90>
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08e2500f-128d-5cf7-82c3-3a4bb266b6aa/08e2500f-128d-5cf7-82c3-3a4bb266b6aa_image_9.png HTTP/1.1" 201 0
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F64%252Fbb6418cf597973190f9eee4d7d453051%252Fpa%252FYH25205_8ad13ded031676e07751df4e535b1715.png') HTTP/1.1" 204 0
2026-03-30 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_8ad13ded031676e07751df4e535b1715.png saved to cache
2026-03-30 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08e2500f-128d-5cf7-82c3-3a4bb266b6aa
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738562d90>
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08e2500f-128d-5cf7-82c3-3a4bb266b6aa/08e2500f-128d-5cf7-82c3-3a4bb266b6aa_image_8.png HTTP/1.1" 201 0
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F64%252Fbb6418cf597973190f9eee4d7d453051%252Fpa%252FYH25205_4f1ca6019d146e78bd4a8f4727589cc0.png') HTTP/1.1" 204 0
2026-03-30 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_4f1ca6019d146e78bd4a8f4727589cc0.png saved to cache
2026-03-30 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08e2500f-128d-5cf7-82c3-3a4bb266b6aa
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073856ee50>
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08e2500f-128d-5cf7-82c3-3a4bb266b6aa/08e2500f-128d-5cf7-82c3-3a4bb266b6aa_image_7.png HTTP/1.1" 201 0
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F64%252Fbb6418cf597973190f9eee4d7d453051%252Fpa%252FYH25205_232229d5904d5518e50c41bb0b882b94.png') HTTP/1.1" 204 0
2026-03-30 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_232229d5904d5518e50c41bb0b882b94.png saved to cache
2026-03-30 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08e2500f-128d-5cf7-82c3-3a4bb266b6aa
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383a8850>
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08e2500f-128d-5cf7-82c3-3a4bb266b6aa/08e2500f-128d-5cf7-82c3-3a4bb266b6aa_image_6.png HTTP/1.1" 201 0
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F64%252Fbb6418cf597973190f9eee4d7d453051%252Fpa%252FYH25205_0b85945b6a3757c1f543f9c217df3f82.png') HTTP/1.1" 204 0
2026-03-30 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_0b85945b6a3757c1f543f9c217df3f82.png saved to cache
2026-03-30 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08e2500f-128d-5cf7-82c3-3a4bb266b6aa
2026-03-30 11:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_051919be8fe329f5c0137dbc4d379843.png> (referer: https://www.auto1.com/)
2026-03-30 11:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_700e0844faf1aa084203cf4fb5d6614a.png> (referer: https://www.auto1.com/)
2026-03-30 11:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_f16b1307e2ddfecd3bbbb56e55f156d8.png> (referer: https://www.auto1.com/)
2026-03-30 11:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_29a6309c54768947fabb4cc23b5f9cf6.png> (referer: https://www.auto1.com/)
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384c6dd0>
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08e2500f-128d-5cf7-82c3-3a4bb266b6aa/08e2500f-128d-5cf7-82c3-3a4bb266b6aa_image_5.png HTTP/1.1" 201 0
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F64%252Fbb6418cf597973190f9eee4d7d453051%252Fpa%252FYH25205_051919be8fe329f5c0137dbc4d379843.png') HTTP/1.1" 204 0
2026-03-30 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_051919be8fe329f5c0137dbc4d379843.png saved to cache
2026-03-30 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08e2500f-128d-5cf7-82c3-3a4bb266b6aa
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a7ece90>
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08e2500f-128d-5cf7-82c3-3a4bb266b6aa/08e2500f-128d-5cf7-82c3-3a4bb266b6aa_image_4.png HTTP/1.1" 201 0
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F64%252Fbb6418cf597973190f9eee4d7d453051%252Fpa%252FYH25205_700e0844faf1aa084203cf4fb5d6614a.png') HTTP/1.1" 204 0
2026-03-30 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_700e0844faf1aa084203cf4fb5d6614a.png saved to cache
2026-03-30 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08e2500f-128d-5cf7-82c3-3a4bb266b6aa
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073856c9d0>
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08e2500f-128d-5cf7-82c3-3a4bb266b6aa/08e2500f-128d-5cf7-82c3-3a4bb266b6aa_image_3.png HTTP/1.1" 201 0
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F64%252Fbb6418cf597973190f9eee4d7d453051%252Fpa%252FYH25205_f16b1307e2ddfecd3bbbb56e55f156d8.png') HTTP/1.1" 204 0
2026-03-30 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_f16b1307e2ddfecd3bbbb56e55f156d8.png saved to cache
2026-03-30 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08e2500f-128d-5cf7-82c3-3a4bb266b6aa
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 11:14:50 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383a8150>
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08e2500f-128d-5cf7-82c3-3a4bb266b6aa/08e2500f-128d-5cf7-82c3-3a4bb266b6aa_image_2.png HTTP/1.1" 201 0
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F64%252Fbb6418cf597973190f9eee4d7d453051%252Fpa%252FYH25205_29a6309c54768947fabb4cc23b5f9cf6.png') HTTP/1.1" 204 0
2026-03-30 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_29a6309c54768947fabb4cc23b5f9cf6.png saved to cache
2026-03-30 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08e2500f-128d-5cf7-82c3-3a4bb266b6aa
2026-03-30 11:14:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08e2500f-128d-5cf7-82c3-3a4bb266b6aa, skipping ID generation
2026-03-30 11:14:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08e2500f-128d-5cf7-82c3-3a4bb266b6aa with scrape type 1
2026-03-30 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08e2500f-128d-5cf7-82c3-3a4bb266b6aa sending to next pipeline
2026-03-30 11:14:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 08e2500f-128d-5cf7-82c3-3a4bb266b6aa, identifier: YH25205
2026-03-30 11:14:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 08e2500f-128d-5cf7-82c3-3a4bb266b6aa with identifier: YH25205
2026-03-30 11:14:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 08e2500f-128d-5cf7-82c3-3a4bb266b6aa with identifier: YH25205
2026-03-30 11:14:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 08e2500f-128d-5cf7-82c3-3a4bb266b6aa with identifier: YH25205 to the API
2026-03-30 11:14:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_29a6309c54768947fabb4cc23b5f9cf6.png>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2026-03-31T15:59:29Z',
'fuel_type': 'petrol',
'id': '08e2500f-128d-5cf7-82c3-3a4bb266b6aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH25205',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500',
'odometer': 21885,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08e2500f-128d-5cf7-82c3-3a4bb266b6aa/08e2500f-128d-5cf7-82c3-3a4bb266b6aa_image_0.png',
'Extension': 'png',
'FileSizeInBytes': 519162,
'Height': 451,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_53344751651eca616c5e9ae7dc65e874.png',
'Width': 619},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08e2500f-128d-5cf7-82c3-3a4bb266b6aa/08e2500f-128d-5cf7-82c3-3a4bb266b6aa_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_eb2ddb7f48a79bebf085614eec89178c.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08e2500f-128d-5cf7-82c3-3a4bb266b6aa/08e2500f-128d-5cf7-82c3-3a4bb266b6aa_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 478670,
'Height': 451,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_29a6309c54768947fabb4cc23b5f9cf6.png',
'Width': 624},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08e2500f-128d-5cf7-82c3-3a4bb266b6aa/08e2500f-128d-5cf7-82c3-3a4bb266b6aa_image_3.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_f16b1307e2ddfecd3bbbb56e55f156d8.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08e2500f-128d-5cf7-82c3-3a4bb266b6aa/08e2500f-128d-5cf7-82c3-3a4bb266b6aa_image_4.png',
'Extension': 'png',
'FileSizeInBytes': 504306,
'Height': 460,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_700e0844faf1aa084203cf4fb5d6614a.png',
'Width': 604},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08e2500f-128d-5cf7-82c3-3a4bb266b6aa/08e2500f-128d-5cf7-82c3-3a4bb266b6aa_image_5.png',
'Extension': 'png',
'FileSizeInBytes': 504037,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_051919be8fe329f5c0137dbc4d379843.png',
'Width': 625},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08e2500f-128d-5cf7-82c3-3a4bb266b6aa/08e2500f-128d-5cf7-82c3-3a4bb266b6aa_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_0b85945b6a3757c1f543f9c217df3f82.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08e2500f-128d-5cf7-82c3-3a4bb266b6aa/08e2500f-128d-5cf7-82c3-3a4bb266b6aa_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_232229d5904d5518e50c41bb0b882b94.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08e2500f-128d-5cf7-82c3-3a4bb266b6aa/08e2500f-128d-5cf7-82c3-3a4bb266b6aa_image_8.png',
'Extension': 'png',
'FileSizeInBytes': 848775,
'Height': 649,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_4f1ca6019d146e78bd4a8f4727589cc0.png',
'Width': 873},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08e2500f-128d-5cf7-82c3-3a4bb266b6aa/08e2500f-128d-5cf7-82c3-3a4bb266b6aa_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/64/bb6418cf597973190f9eee4d7d453051/pa/YH25205_8ad13ded031676e07751df4e535b1715.png',
'Width': 512}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-19',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid',
'transmission': 'manual',
'trim': '',
'year': 2023}
2026-03-30 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH25205%27 HTTP/1.1" 200 None
2026-03-30 11:14:51 [auto1.fr] INFO: Saving data for YH25205: {'created_time': 1774869291.409281, 'last_price_update_time': 1774869291.409291, 'auction_closing_time': 1774972769.0}
2026-03-30 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YH25205') HTTP/1.1" 204 0
2026-03-30 11:14:52 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.345(s), this was the 1st time calling it.
2026-03-30 11:14:52 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.84720777834597 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:14:56 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.173(s), this was the 1st time calling it.
2026-03-30 11:14:56 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.335903218564444 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:14:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:15:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:15:05 [scrapy.extensions.logstats] INFO: Crawled 72 pages (at 5 pages/min), scraped 67 items (at 7 items/min)
2026-03-30 11:15:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:15:10 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.724(s), this was the 1st time calling it.
2026-03-30 11:15:10 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.273008754513811 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:15:13 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.245(s), this was the 1st time calling it.
2026-03-30 11:15:13 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.555263000562894 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:15:13 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.382(s), this was the 1st time calling it.
2026-03-30 11:15:13 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.27088955493178 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:15:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:15:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:15:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.407(s), this was the 1st time calling it.
2026-03-30 11:15:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.427714466648699 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:15:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:15:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP55875> (referer: https://www.auto1.com/v1/car-details-view/KP55875/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2ea97c3-5e48-51ba-abb2-ba5b9374a17b with identifier: KP55875
2026-03-30 11:15:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2ea97c3-5e48-51ba-abb2-ba5b9374a17b with scrape type 1
2026-03-30 11:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2ea97c3-5e48-51ba-abb2-ba5b9374a17b
2026-03-30 11:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F0d%252F090da58546c4b6e196512b34183851d8%252Fpa%252FKP55875_7bf613b1e420ffde10d9360dd72bb01a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_7bf613b1e420ffde10d9360dd72bb01a.jpg already downloaded
2026-03-30 11:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F0d%252F090da58546c4b6e196512b34183851d8%252Fpa%252FKP55875_6c871e9a304714c3b07790379e0bd12f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_6c871e9a304714c3b07790379e0bd12f.jpg already downloaded
2026-03-30 11:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F0d%252F090da58546c4b6e196512b34183851d8%252Fpa%252FKP55875_92c4aa83843af622c0353f3adb9cb4d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_92c4aa83843af622c0353f3adb9cb4d8.jpg already downloaded
2026-03-30 11:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F0d%252F090da58546c4b6e196512b34183851d8%252Fpa%252FKP55875_ef52d7c00d29670fef97b8806eeb1af7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_ef52d7c00d29670fef97b8806eeb1af7.jpg already downloaded
2026-03-30 11:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F0d%252F090da58546c4b6e196512b34183851d8%252Fpa%252FKP55875_9717d678d3d98d876577bd75120740d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_9717d678d3d98d876577bd75120740d3.jpg already downloaded
2026-03-30 11:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F0d%252F090da58546c4b6e196512b34183851d8%252Fpa%252FKP55875_bdf5c08e48f262528714a3f93f74c7a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_bdf5c08e48f262528714a3f93f74c7a0.jpg already downloaded
2026-03-30 11:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F0d%252F090da58546c4b6e196512b34183851d8%252Fpa%252FKP55875_8bf47b04cf4ca10b983e51a7fd5ea99f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_8bf47b04cf4ca10b983e51a7fd5ea99f.jpg already downloaded
2026-03-30 11:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F0d%252F090da58546c4b6e196512b34183851d8%252Fpa%252FKP55875_a95290e2bbf59c76e65272c9bc8b44b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_a95290e2bbf59c76e65272c9bc8b44b0.jpg already downloaded
2026-03-30 11:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F0d%252F090da58546c4b6e196512b34183851d8%252Fpa%252FKP55875_c02fe2e9fa8da8af87c34e77f2f3f910.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_c02fe2e9fa8da8af87c34e77f2f3f910.jpg already downloaded
2026-03-30 11:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F0d%252F090da58546c4b6e196512b34183851d8%252Fpa%252FKP55875_947faadaec658001238e596fbc6dfe8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_947faadaec658001238e596fbc6dfe8a.jpg already downloaded
2026-03-30 11:15:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a2ea97c3-5e48-51ba-abb2-ba5b9374a17b, identifier: KP55875
2026-03-30 11:15:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a2ea97c3-5e48-51ba-abb2-ba5b9374a17b with identifier: KP55875
2026-03-30 11:15:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a2ea97c3-5e48-51ba-abb2-ba5b9374a17b with identifier: KP55875
2026-03-30 11:15:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a2ea97c3-5e48-51ba-abb2-ba5b9374a17b with identifier: KP55875 to the API
2026-03-30 11:15:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:15:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:15:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KP55875>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:26:43Z',
'fuel_type': 'diesel',
'id': 'a2ea97c3-5e48-51ba-abb2-ba5b9374a17b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP55875',
'listing': 'auction',
'location': 'FR, TARNOS',
'make': 'Peugeot',
'model': '308',
'odometer': 259161,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photo_urls': ['https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_7bf613b1e420ffde10d9360dd72bb01a.jpg',
'https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_6c871e9a304714c3b07790379e0bd12f.jpg',
'https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_92c4aa83843af622c0353f3adb9cb4d8.jpg',
'https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_ef52d7c00d29670fef97b8806eeb1af7.jpg',
'https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_9717d678d3d98d876577bd75120740d3.jpg',
'https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_bdf5c08e48f262528714a3f93f74c7a0.jpg',
'https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_8bf47b04cf4ca10b983e51a7fd5ea99f.jpg',
'https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_a95290e2bbf59c76e65272c9bc8b44b0.jpg',
'https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_c02fe2e9fa8da8af87c34e77f2f3f910.jpg',
'https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_947faadaec658001238e596fbc6dfe8a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ea97c3-5e48-51ba-abb2-ba5b9374a17b/a2ea97c3-5e48-51ba-abb2-ba5b9374a17b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50686,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_7bf613b1e420ffde10d9360dd72bb01a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ea97c3-5e48-51ba-abb2-ba5b9374a17b/a2ea97c3-5e48-51ba-abb2-ba5b9374a17b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54062,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_6c871e9a304714c3b07790379e0bd12f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ea97c3-5e48-51ba-abb2-ba5b9374a17b/a2ea97c3-5e48-51ba-abb2-ba5b9374a17b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_92c4aa83843af622c0353f3adb9cb4d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ea97c3-5e48-51ba-abb2-ba5b9374a17b/a2ea97c3-5e48-51ba-abb2-ba5b9374a17b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_ef52d7c00d29670fef97b8806eeb1af7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ea97c3-5e48-51ba-abb2-ba5b9374a17b/a2ea97c3-5e48-51ba-abb2-ba5b9374a17b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53477,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_9717d678d3d98d876577bd75120740d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ea97c3-5e48-51ba-abb2-ba5b9374a17b/a2ea97c3-5e48-51ba-abb2-ba5b9374a17b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50135,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_bdf5c08e48f262528714a3f93f74c7a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ea97c3-5e48-51ba-abb2-ba5b9374a17b/a2ea97c3-5e48-51ba-abb2-ba5b9374a17b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41571,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_8bf47b04cf4ca10b983e51a7fd5ea99f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ea97c3-5e48-51ba-abb2-ba5b9374a17b/a2ea97c3-5e48-51ba-abb2-ba5b9374a17b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95665,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_a95290e2bbf59c76e65272c9bc8b44b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ea97c3-5e48-51ba-abb2-ba5b9374a17b/a2ea97c3-5e48-51ba-abb2-ba5b9374a17b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74467,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_c02fe2e9fa8da8af87c34e77f2f3f910.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ea97c3-5e48-51ba-abb2-ba5b9374a17b/a2ea97c3-5e48-51ba-abb2-ba5b9374a17b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79809,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/0d/090da58546c4b6e196512b34183851d8/pa/KP55875_947faadaec658001238e596fbc6dfe8a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 e-HDi Feline',
'transmission': 'manual',
'trim': 'Feline',
'year': 2012}
2026-03-30 11:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP55875%27 HTTP/1.1" 200 None
2026-03-30 11:15:18 [auto1.fr] INFO: Saving data for KP55875: {'created_time': 1774869318.305298, 'last_price_update_time': 1774869318.305308, 'auction_closing_time': 1774970803.0}
2026-03-30 11:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KP55875') HTTP/1.1" 204 0
2026-03-30 11:15:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:15:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG05877/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FS93369/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA13685/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA74710/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:35 [auto1.fr] INFO: Channel: 24h | Page: 10 | totalHits: 5564 | hits on page: 40
2026-03-30 11:15:35 [auto1.fr] INFO: Found listing with ID: HR25538
2026-03-30 11:15:35 [auto1.fr] INFO: Found listing with ID: PB55961
2026-03-30 11:15:35 [auto1.fr] INFO: Found listing with ID: AZ61260
2026-03-30 11:15:35 [auto1.fr] INFO: Found listing with ID: AL31248
2026-03-30 11:15:35 [auto1.fr] INFO: Found listing with ID: HB67890
2026-03-30 11:15:35 [auto1.fr] INFO: Found listing with ID: CA62859
2026-03-30 11:15:35 [auto1.fr] INFO: Found listing with ID: ER94333
2026-03-30 11:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER94333%27 HTTP/1.1" 200 None
2026-03-30 11:15:35 [auto1.fr] INFO: Scrape type for ER94333: 2
2026-03-30 11:15:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c32a2b2-ef02-5e0a-a9d9-0fecf2eae2a5 with identifier: ER94333
2026-03-30 11:15:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c32a2b2-ef02-5e0a-a9d9-0fecf2eae2a5 with scrape type 2
2026-03-30 11:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c32a2b2-ef02-5e0a-a9d9-0fecf2eae2a5 with scrape type 2
2026-03-30 11:15:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5c32a2b2-ef02-5e0a-a9d9-0fecf2eae2a5, identifier: ER94333
2026-03-30 11:15:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5c32a2b2-ef02-5e0a-a9d9-0fecf2eae2a5 with identifier: ER94333
2026-03-30 11:15:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5c32a2b2-ef02-5e0a-a9d9-0fecf2eae2a5 with identifier: ER94333
2026-03-30 11:15:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5c32a2b2-ef02-5e0a-a9d9-0fecf2eae2a5 with identifier: ER94333 to the API
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:15:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 58,
'expiration_date': '2026-03-31T15:37:52Z',
'fuel_type': 'petrol',
'id': '5c32a2b2-ef02-5e0a-a9d9-0fecf2eae2a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER94333',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 139283,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-11-20',
'seller_name': None,
'title': 'Renault Clio 1.2 Campus Authentique',
'transmission': 'manual',
'trim': 'Campus Authentique',
'year': 2008}
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER94333%27 HTTP/1.1" 200 None
2026-03-30 11:15:36 [auto1.fr] INFO: Saving data for ER94333: {'auction_closing_time': 1774971472.0, 'created_time': 1773832233.42288, 'last_price_update_time': 1774869336.283266}
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ER94333') HTTP/1.1" 204 0
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: WU73634
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: TZ86489
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ86489%27 HTTP/1.1" 200 None
2026-03-30 11:15:36 [auto1.fr] INFO: Scrape type for TZ86489: 1
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: PV12001
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV12001%27 HTTP/1.1" 200 None
2026-03-30 11:15:36 [auto1.fr] INFO: Scrape type for PV12001: 1
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: VD06652
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: UV64510
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV64510%27 HTTP/1.1" 200 None
2026-03-30 11:15:36 [auto1.fr] INFO: Scrape type for UV64510: 1
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: SN68527
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: XE23390
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: UL33581
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: KT63849
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: GC83047
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: LY86888
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: RD85936
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD85936%27 HTTP/1.1" 200 None
2026-03-30 11:15:36 [auto1.fr] INFO: Scrape type for RD85936: 1
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: VT02723
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT02723%27 HTTP/1.1" 200 None
2026-03-30 11:15:36 [auto1.fr] INFO: Scrape type for VT02723: 1
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: GV35927
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: DE97231
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: HC40418
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: KX63336
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: AV52301
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: MK51863
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: PJ68004
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ68004%27 HTTP/1.1" 200 None
2026-03-30 11:15:36 [auto1.fr] INFO: Scrape type for PJ68004: 2
2026-03-30 11:15:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cce47a3b-c9fb-5cdd-ab53-0a74639f8c89 with identifier: PJ68004
2026-03-30 11:15:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cce47a3b-c9fb-5cdd-ab53-0a74639f8c89 with scrape type 2
2026-03-30 11:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cce47a3b-c9fb-5cdd-ab53-0a74639f8c89 with scrape type 2
2026-03-30 11:15:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cce47a3b-c9fb-5cdd-ab53-0a74639f8c89, identifier: PJ68004
2026-03-30 11:15:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cce47a3b-c9fb-5cdd-ab53-0a74639f8c89 with identifier: PJ68004
2026-03-30 11:15:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cce47a3b-c9fb-5cdd-ab53-0a74639f8c89 with identifier: PJ68004
2026-03-30 11:15:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cce47a3b-c9fb-5cdd-ab53-0a74639f8c89 with identifier: PJ68004 to the API
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:15:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:38:12Z',
'fuel_type': 'diesel',
'id': 'cce47a3b-c9fb-5cdd-ab53-0a74639f8c89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ68004',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 317575,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-07',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2011}
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ68004%27 HTTP/1.1" 200 None
2026-03-30 11:15:36 [auto1.fr] INFO: Saving data for PJ68004: {'auction_closing_time': 1774971492.0, 'created_time': 1773673817.824368, 'last_price_update_time': 1774869336.849711}
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PJ68004') HTTP/1.1" 204 0
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: AG05913
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: AE64159
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: RZ51319
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: GG06949
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: DD12219
2026-03-30 11:15:36 [auto1.fr] INFO: Found listing with ID: DS07902
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS07902%27 HTTP/1.1" 200 None
2026-03-30 11:15:36 [auto1.fr] INFO: Scrape type for DS07902: 2
2026-03-30 11:15:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e1aec3b-5afc-5f38-9dbe-675d984d1b28 with identifier: DS07902
2026-03-30 11:15:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e1aec3b-5afc-5f38-9dbe-675d984d1b28 with scrape type 2
2026-03-30 11:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e1aec3b-5afc-5f38-9dbe-675d984d1b28 with scrape type 2
2026-03-30 11:15:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0e1aec3b-5afc-5f38-9dbe-675d984d1b28, identifier: DS07902
2026-03-30 11:15:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0e1aec3b-5afc-5f38-9dbe-675d984d1b28 with identifier: DS07902
2026-03-30 11:15:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0e1aec3b-5afc-5f38-9dbe-675d984d1b28 with identifier: DS07902
2026-03-30 11:15:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0e1aec3b-5afc-5f38-9dbe-675d984d1b28 with identifier: DS07902 to the API
2026-03-30 11:15:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:15:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:15:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-31T15:03:10Z',
'fuel_type': 'petrol',
'id': '0e1aec3b-5afc-5f38-9dbe-675d984d1b28',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS07902',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 164089,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-04-28',
'seller_name': None,
'title': 'Peugeot 207 1.4 Trendy',
'transmission': 'manual',
'trim': 'Trendy',
'year': 2008}
2026-03-30 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS07902%27 HTTP/1.1" 200 None
2026-03-30 11:15:37 [auto1.fr] INFO: Saving data for DS07902: {'auction_closing_time': 1774969390.0, 'created_time': 1774537779.083574, 'last_price_update_time': 1774869337.606664}
2026-03-30 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DS07902') HTTP/1.1" 204 0
2026-03-30 11:15:37 [auto1.fr] INFO: Found listing with ID: GK41383
2026-03-30 11:15:37 [auto1.fr] INFO: Found listing with ID: WR47867
2026-03-30 11:15:37 [auto1.fr] INFO: Found listing with ID: ND41633
2026-03-30 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ND41633%27 HTTP/1.1" 200 None
2026-03-30 11:15:37 [auto1.fr] INFO: Scrape type for ND41633: 1
2026-03-30 11:15:37 [auto1.fr] INFO: Found listing with ID: WJ51086
2026-03-30 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ51086%27 HTTP/1.1" 200 None
2026-03-30 11:15:37 [auto1.fr] INFO: Scrape type for WJ51086: 1
2026-03-30 11:15:37 [auto1.fr] INFO: Found listing with ID: XT21215
2026-03-30 11:15:37 [auto1.fr] INFO: Found listing with ID: AV23705
2026-03-30 11:15:37 [auto1.fr] INFO: Found listing with ID: LK92723
2026-03-30 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK92723%27 HTTP/1.1" 200 None
2026-03-30 11:15:37 [auto1.fr] INFO: Scrape type for LK92723: 2
2026-03-30 11:15:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1e07261-84af-5d7c-95ba-829ec7d5f4ec with identifier: LK92723
2026-03-30 11:15:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1e07261-84af-5d7c-95ba-829ec7d5f4ec with scrape type 2
2026-03-30 11:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1e07261-84af-5d7c-95ba-829ec7d5f4ec with scrape type 2
2026-03-30 11:15:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b1e07261-84af-5d7c-95ba-829ec7d5f4ec, identifier: LK92723
2026-03-30 11:15:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b1e07261-84af-5d7c-95ba-829ec7d5f4ec with identifier: LK92723
2026-03-30 11:15:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b1e07261-84af-5d7c-95ba-829ec7d5f4ec with identifier: LK92723
2026-03-30 11:15:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b1e07261-84af-5d7c-95ba-829ec7d5f4ec with identifier: LK92723 to the API
2026-03-30 11:15:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:15:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:15:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:32:58Z',
'fuel_type': 'petrol',
'id': 'b1e07261-84af-5d7c-95ba-829ec7d5f4ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK92723',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 111586,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-25',
'seller_name': None,
'title': 'Peugeot 208 1.2 e-THP Roland Garros',
'transmission': 'manual',
'trim': 'Roland Garros',
'year': 2017}
2026-03-30 11:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK92723%27 HTTP/1.1" 200 None
2026-03-30 11:15:38 [auto1.fr] INFO: Saving data for LK92723: {'auction_closing_time': 1774971178.0, 'created_time': 1773832159.106274, 'last_price_update_time': 1774869338.204734}
2026-03-30 11:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LK92723') HTTP/1.1" 204 0
2026-03-30 11:15:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF41129/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG05877> (referer: https://www.auto1.com/v1/car-details-view/UG05877/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 660d89dd-12fe-5d3d-b398-a9c1ff97f95a with identifier: UG05877
2026-03-30 11:15:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 660d89dd-12fe-5d3d-b398-a9c1ff97f95a with scrape type 1
2026-03-30 11:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 660d89dd-12fe-5d3d-b398-a9c1ff97f95a
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F48%252Fda48321aa5ccea80630f4c3b97a976ac%252Fpa%252FUG05877_50159aef508dd664ad0a27bfe28c9218.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_50159aef508dd664ad0a27bfe28c9218.jpg already downloaded
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F48%252Fda48321aa5ccea80630f4c3b97a976ac%252Fpa%252FUG05877_7b570dca3044232f420a91ab8da86145.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_7b570dca3044232f420a91ab8da86145.jpg already downloaded
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F48%252Fda48321aa5ccea80630f4c3b97a976ac%252Fpa%252FUG05877_fa515fabc0eecfbe5a201b6e856a98d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_fa515fabc0eecfbe5a201b6e856a98d3.jpg already downloaded
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F48%252Fda48321aa5ccea80630f4c3b97a976ac%252Fpa%252FUG05877_e7651d9c4d9a7af603d54118ab58909f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_e7651d9c4d9a7af603d54118ab58909f.jpg already downloaded
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F48%252Fda48321aa5ccea80630f4c3b97a976ac%252Fpa%252FUG05877_192a1ae31fedf073aaacda160ac4968f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_192a1ae31fedf073aaacda160ac4968f.jpg already downloaded
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F48%252Fda48321aa5ccea80630f4c3b97a976ac%252Fpa%252FUG05877_eb3d9ede1218aaac93c594e7695c0593.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_eb3d9ede1218aaac93c594e7695c0593.jpg already downloaded
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F48%252Fda48321aa5ccea80630f4c3b97a976ac%252Fpa%252FUG05877_643a7b4acdd73580a8ed96eb6e98ab88.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_643a7b4acdd73580a8ed96eb6e98ab88.jpg already downloaded
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F48%252Fda48321aa5ccea80630f4c3b97a976ac%252Fpa%252FUG05877_907d0ef008b9569961a5eb21b2f79a76.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_907d0ef008b9569961a5eb21b2f79a76.jpg already downloaded
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F48%252Fda48321aa5ccea80630f4c3b97a976ac%252Fpa%252FUG05877_126cd92b6bc61879ed6d43aef4dc5bba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_126cd92b6bc61879ed6d43aef4dc5bba.jpg already downloaded
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F48%252Fda48321aa5ccea80630f4c3b97a976ac%252Fpa%252FUG05877_4e9a6657528341d4ee742b1a06adfc0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_4e9a6657528341d4ee742b1a06adfc0b.jpg already downloaded
2026-03-30 11:15:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 660d89dd-12fe-5d3d-b398-a9c1ff97f95a, identifier: UG05877
2026-03-30 11:15:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 660d89dd-12fe-5d3d-b398-a9c1ff97f95a with identifier: UG05877
2026-03-30 11:15:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 660d89dd-12fe-5d3d-b398-a9c1ff97f95a with identifier: UG05877
2026-03-30 11:15:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 660d89dd-12fe-5d3d-b398-a9c1ff97f95a with identifier: UG05877 to the API
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:15:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UG05877>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:43:35Z',
'fuel_type': 'diesel',
'id': '660d89dd-12fe-5d3d-b398-a9c1ff97f95a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG05877',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'BMW',
'model': 'X1',
'odometer': 141723,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_50159aef508dd664ad0a27bfe28c9218.jpg',
'https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_7b570dca3044232f420a91ab8da86145.jpg',
'https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_fa515fabc0eecfbe5a201b6e856a98d3.jpg',
'https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_e7651d9c4d9a7af603d54118ab58909f.jpg',
'https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_192a1ae31fedf073aaacda160ac4968f.jpg',
'https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_eb3d9ede1218aaac93c594e7695c0593.jpg',
'https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_643a7b4acdd73580a8ed96eb6e98ab88.jpg',
'https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_907d0ef008b9569961a5eb21b2f79a76.jpg',
'https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_126cd92b6bc61879ed6d43aef4dc5bba.jpg',
'https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_4e9a6657528341d4ee742b1a06adfc0b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660d89dd-12fe-5d3d-b398-a9c1ff97f95a/660d89dd-12fe-5d3d-b398-a9c1ff97f95a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78632,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_50159aef508dd664ad0a27bfe28c9218.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660d89dd-12fe-5d3d-b398-a9c1ff97f95a/660d89dd-12fe-5d3d-b398-a9c1ff97f95a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76682,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_7b570dca3044232f420a91ab8da86145.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660d89dd-12fe-5d3d-b398-a9c1ff97f95a/660d89dd-12fe-5d3d-b398-a9c1ff97f95a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70247,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_fa515fabc0eecfbe5a201b6e856a98d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660d89dd-12fe-5d3d-b398-a9c1ff97f95a/660d89dd-12fe-5d3d-b398-a9c1ff97f95a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58226,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_e7651d9c4d9a7af603d54118ab58909f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660d89dd-12fe-5d3d-b398-a9c1ff97f95a/660d89dd-12fe-5d3d-b398-a9c1ff97f95a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_192a1ae31fedf073aaacda160ac4968f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660d89dd-12fe-5d3d-b398-a9c1ff97f95a/660d89dd-12fe-5d3d-b398-a9c1ff97f95a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2556484,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_eb3d9ede1218aaac93c594e7695c0593.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660d89dd-12fe-5d3d-b398-a9c1ff97f95a/660d89dd-12fe-5d3d-b398-a9c1ff97f95a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2447293,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_643a7b4acdd73580a8ed96eb6e98ab88.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660d89dd-12fe-5d3d-b398-a9c1ff97f95a/660d89dd-12fe-5d3d-b398-a9c1ff97f95a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2598535,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_907d0ef008b9569961a5eb21b2f79a76.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660d89dd-12fe-5d3d-b398-a9c1ff97f95a/660d89dd-12fe-5d3d-b398-a9c1ff97f95a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73777,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_126cd92b6bc61879ed6d43aef4dc5bba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660d89dd-12fe-5d3d-b398-a9c1ff97f95a/660d89dd-12fe-5d3d-b398-a9c1ff97f95a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57086,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/48/da48321aa5ccea80630f4c3b97a976ac/pa/UG05877_4e9a6657528341d4ee742b1a06adfc0b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-07',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 xDrive 18d xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2017}
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG05877%27 HTTP/1.1" 200 None
2026-03-30 11:15:43 [auto1.fr] INFO: Saving data for UG05877: {'created_time': 1774869343.626259, 'last_price_update_time': 1774869343.626271, 'auction_closing_time': 1774971815.0}
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UG05877') HTTP/1.1" 204 0
2026-03-30 11:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EZ95306> (referer: https://www.auto1.com/v1/car-details-view/EZ95306/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b808177-78b5-575e-954f-2e8e1e0e2c2b with identifier: EZ95306
2026-03-30 11:16:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b808177-78b5-575e-954f-2e8e1e0e2c2b with scrape type 1
2026-03-30 11:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b808177-78b5-575e-954f-2e8e1e0e2c2b
2026-03-30 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff4%252Fecf4d85f7201bb383996482691b84add%252Fpa%252FEZ95306_6110abee2394ac0852aae750d6201560.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_6110abee2394ac0852aae750d6201560.jpg not downloaded yet
2026-03-30 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff4%252Fecf4d85f7201bb383996482691b84add%252Fpa%252FEZ95306_881f3a73ffc364373be9fed3ef9286b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_881f3a73ffc364373be9fed3ef9286b6.jpg not downloaded yet
2026-03-30 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff4%252Fecf4d85f7201bb383996482691b84add%252Fpa%252FEZ95306_e13a82acbf041ae86de08ccdb56449a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_e13a82acbf041ae86de08ccdb56449a4.jpg not downloaded yet
2026-03-30 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff4%252Fecf4d85f7201bb383996482691b84add%252Fpa%252FEZ95306_117fac6942e09eb450b922b6800f681c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_117fac6942e09eb450b922b6800f681c.jpg not downloaded yet
2026-03-30 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff4%252Fecf4d85f7201bb383996482691b84add%252Fpa%252FEZ95306_1a097043f1dfc03874c0f91245a8f906.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_1a097043f1dfc03874c0f91245a8f906.jpg not downloaded yet
2026-03-30 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff4%252Fecf4d85f7201bb383996482691b84add%252Fpa%252FEZ95306_bb9f76761a5ae739a49202881533a2ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_bb9f76761a5ae739a49202881533a2ef.jpg not downloaded yet
2026-03-30 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff4%252Fecf4d85f7201bb383996482691b84add%252Fpa%252FEZ95306_7831cce895160d9734a3b63d5f1dd290.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_7831cce895160d9734a3b63d5f1dd290.jpg not downloaded yet
2026-03-30 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff4%252Fecf4d85f7201bb383996482691b84add%252Fpa%252FEZ95306_a40eb3e1ade239120ee7b6861cd4216f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_a40eb3e1ade239120ee7b6861cd4216f.jpg not downloaded yet
2026-03-30 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff4%252Fecf4d85f7201bb383996482691b84add%252Fpa%252FEZ95306_fa874ffac9e636b473b9a8330ae45175.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_fa874ffac9e636b473b9a8330ae45175.jpg not downloaded yet
2026-03-30 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff4%252Fecf4d85f7201bb383996482691b84add%252Fpa%252FEZ95306_a5fd842eefc91116ecddfb110205ecf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_a5fd842eefc91116ecddfb110205ecf3.jpg not downloaded yet
2026-03-30 11:16:05 [scrapy.extensions.logstats] INFO: Crawled 81 pages (at 9 pages/min), scraped 73 items (at 6 items/min)
2026-03-30 11:16:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:16:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA13685> (referer: https://www.auto1.com/v1/car-details-view/HA13685/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce2598e7-65e6-5885-9d44-33cadcbf9202 with identifier: HA13685
2026-03-30 11:16:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce2598e7-65e6-5885-9d44-33cadcbf9202 with scrape type 1
2026-03-30 11:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ce2598e7-65e6-5885-9d44-33cadcbf9202
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Ffc%252Fddfc6f2c3cd9a73ad4b0f8dea7923746%252Fpa%252FHA13685_28a4d70733a59f8d6838c973e492c38f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_28a4d70733a59f8d6838c973e492c38f.jpg already downloaded
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Ffc%252Fddfc6f2c3cd9a73ad4b0f8dea7923746%252Fpa%252FHA13685_d336a1d772aff2cee7124f4b8c6c92fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_d336a1d772aff2cee7124f4b8c6c92fa.jpg already downloaded
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Ffc%252Fddfc6f2c3cd9a73ad4b0f8dea7923746%252Fpa%252FHA13685_480277a8a5d6deb88a7c9f295d991176.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_480277a8a5d6deb88a7c9f295d991176.jpg already downloaded
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Ffc%252Fddfc6f2c3cd9a73ad4b0f8dea7923746%252Fpa%252FHA13685_18ba11cbf231c7cb12c44acb81fb3e8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_18ba11cbf231c7cb12c44acb81fb3e8d.jpg already downloaded
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Ffc%252Fddfc6f2c3cd9a73ad4b0f8dea7923746%252Fpa%252FHA13685_da31bd959c971e933e3d1ba546afe6ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_da31bd959c971e933e3d1ba546afe6ea.jpg already downloaded
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Ffc%252Fddfc6f2c3cd9a73ad4b0f8dea7923746%252Fpa%252FHA13685_72151c4dcb92071f00d822c4e5678a7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_72151c4dcb92071f00d822c4e5678a7e.jpg already downloaded
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Ffc%252Fddfc6f2c3cd9a73ad4b0f8dea7923746%252Fpa%252FHA13685_10eae09163a9a4330263f3c01703536f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_10eae09163a9a4330263f3c01703536f.jpg already downloaded
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Ffc%252Fddfc6f2c3cd9a73ad4b0f8dea7923746%252Fpa%252FHA13685_30d08010784930c70662d4487bbf9524.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_30d08010784930c70662d4487bbf9524.jpg already downloaded
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Ffc%252Fddfc6f2c3cd9a73ad4b0f8dea7923746%252Fpa%252FHA13685_c448462652287bb98ed749c39abad733.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_c448462652287bb98ed749c39abad733.jpg already downloaded
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Ffc%252Fddfc6f2c3cd9a73ad4b0f8dea7923746%252Fpa%252FHA13685_d1f5dd476cbca5e090cdc8b5cd03378d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_d1f5dd476cbca5e090cdc8b5cd03378d.jpg already downloaded
2026-03-30 11:16:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ce2598e7-65e6-5885-9d44-33cadcbf9202, identifier: HA13685
2026-03-30 11:16:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ce2598e7-65e6-5885-9d44-33cadcbf9202 with identifier: HA13685
2026-03-30 11:16:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ce2598e7-65e6-5885-9d44-33cadcbf9202 with identifier: HA13685
2026-03-30 11:16:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ce2598e7-65e6-5885-9d44-33cadcbf9202 with identifier: HA13685 to the API
2026-03-30 11:16:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HA13685>
{'auction_title': '',
'c_o_2_emission_value': 100,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:52:57Z',
'fuel_type': 'diesel',
'id': 'ce2598e7-65e6-5885-9d44-33cadcbf9202',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA13685',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 81278,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_28a4d70733a59f8d6838c973e492c38f.jpg',
'https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_d336a1d772aff2cee7124f4b8c6c92fa.jpg',
'https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_480277a8a5d6deb88a7c9f295d991176.jpg',
'https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_18ba11cbf231c7cb12c44acb81fb3e8d.jpg',
'https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_da31bd959c971e933e3d1ba546afe6ea.jpg',
'https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_72151c4dcb92071f00d822c4e5678a7e.jpg',
'https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_10eae09163a9a4330263f3c01703536f.jpg',
'https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_30d08010784930c70662d4487bbf9524.jpg',
'https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_c448462652287bb98ed749c39abad733.jpg',
'https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_d1f5dd476cbca5e090cdc8b5cd03378d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce2598e7-65e6-5885-9d44-33cadcbf9202/ce2598e7-65e6-5885-9d44-33cadcbf9202_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86249,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_28a4d70733a59f8d6838c973e492c38f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce2598e7-65e6-5885-9d44-33cadcbf9202/ce2598e7-65e6-5885-9d44-33cadcbf9202_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2579298,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_d336a1d772aff2cee7124f4b8c6c92fa.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce2598e7-65e6-5885-9d44-33cadcbf9202/ce2598e7-65e6-5885-9d44-33cadcbf9202_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70523,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_480277a8a5d6deb88a7c9f295d991176.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce2598e7-65e6-5885-9d44-33cadcbf9202/ce2598e7-65e6-5885-9d44-33cadcbf9202_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50340,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_18ba11cbf231c7cb12c44acb81fb3e8d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce2598e7-65e6-5885-9d44-33cadcbf9202/ce2598e7-65e6-5885-9d44-33cadcbf9202_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65277,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_da31bd959c971e933e3d1ba546afe6ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce2598e7-65e6-5885-9d44-33cadcbf9202/ce2598e7-65e6-5885-9d44-33cadcbf9202_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72264,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_72151c4dcb92071f00d822c4e5678a7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce2598e7-65e6-5885-9d44-33cadcbf9202/ce2598e7-65e6-5885-9d44-33cadcbf9202_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56752,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_10eae09163a9a4330263f3c01703536f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce2598e7-65e6-5885-9d44-33cadcbf9202/ce2598e7-65e6-5885-9d44-33cadcbf9202_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81756,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_30d08010784930c70662d4487bbf9524.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce2598e7-65e6-5885-9d44-33cadcbf9202/ce2598e7-65e6-5885-9d44-33cadcbf9202_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2888157,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_c448462652287bb98ed749c39abad733.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce2598e7-65e6-5885-9d44-33cadcbf9202/ce2598e7-65e6-5885-9d44-33cadcbf9202_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/fc/ddfc6f2c3cd9a73ad4b0f8dea7923746/pa/HA13685_d1f5dd476cbca5e090cdc8b5cd03378d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-04-18',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 d',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA13685%27 HTTP/1.1" 200 None
2026-03-30 11:16:17 [auto1.fr] INFO: Saving data for HA13685: {'created_time': 1774869377.265089, 'last_price_update_time': 1774869377.265101, 'auction_closing_time': 1774972377.0}
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HA13685') HTTP/1.1" 204 0
2026-03-30 11:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_a5fd842eefc91116ecddfb110205ecf3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_fa874ffac9e636b473b9a8330ae45175.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385d7cd0>
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b808177-78b5-575e-954f-2e8e1e0e2c2b/9b808177-78b5-575e-954f-2e8e1e0e2c2b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff4%252Fecf4d85f7201bb383996482691b84add%252Fpa%252FEZ95306_a5fd842eefc91116ecddfb110205ecf3.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_a5fd842eefc91116ecddfb110205ecf3.jpg saved to cache
2026-03-30 11:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b808177-78b5-575e-954f-2e8e1e0e2c2b
2026-03-30 11:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_a40eb3e1ade239120ee7b6861cd4216f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384d8dd0>
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b808177-78b5-575e-954f-2e8e1e0e2c2b/9b808177-78b5-575e-954f-2e8e1e0e2c2b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff4%252Fecf4d85f7201bb383996482691b84add%252Fpa%252FEZ95306_fa874ffac9e636b473b9a8330ae45175.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_fa874ffac9e636b473b9a8330ae45175.jpg saved to cache
2026-03-30 11:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b808177-78b5-575e-954f-2e8e1e0e2c2b
2026-03-30 11:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_7831cce895160d9734a3b63d5f1dd290.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_bb9f76761a5ae739a49202881533a2ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738562750>
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b808177-78b5-575e-954f-2e8e1e0e2c2b/9b808177-78b5-575e-954f-2e8e1e0e2c2b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff4%252Fecf4d85f7201bb383996482691b84add%252Fpa%252FEZ95306_a40eb3e1ade239120ee7b6861cd4216f.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_a40eb3e1ade239120ee7b6861cd4216f.jpg saved to cache
2026-03-30 11:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b808177-78b5-575e-954f-2e8e1e0e2c2b
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383b2fd0>
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b808177-78b5-575e-954f-2e8e1e0e2c2b/9b808177-78b5-575e-954f-2e8e1e0e2c2b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff4%252Fecf4d85f7201bb383996482691b84add%252Fpa%252FEZ95306_7831cce895160d9734a3b63d5f1dd290.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_7831cce895160d9734a3b63d5f1dd290.jpg saved to cache
2026-03-30 11:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b808177-78b5-575e-954f-2e8e1e0e2c2b
2026-03-30 11:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_1a097043f1dfc03874c0f91245a8f906.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07393f47d0>
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b808177-78b5-575e-954f-2e8e1e0e2c2b/9b808177-78b5-575e-954f-2e8e1e0e2c2b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff4%252Fecf4d85f7201bb383996482691b84add%252Fpa%252FEZ95306_bb9f76761a5ae739a49202881533a2ef.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_bb9f76761a5ae739a49202881533a2ef.jpg saved to cache
2026-03-30 11:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b808177-78b5-575e-954f-2e8e1e0e2c2b
2026-03-30 11:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_117fac6942e09eb450b922b6800f681c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738780210>
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b808177-78b5-575e-954f-2e8e1e0e2c2b/9b808177-78b5-575e-954f-2e8e1e0e2c2b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff4%252Fecf4d85f7201bb383996482691b84add%252Fpa%252FEZ95306_1a097043f1dfc03874c0f91245a8f906.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_1a097043f1dfc03874c0f91245a8f906.jpg saved to cache
2026-03-30 11:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b808177-78b5-575e-954f-2e8e1e0e2c2b
2026-03-30 11:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_e13a82acbf041ae86de08ccdb56449a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073842b690>
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b808177-78b5-575e-954f-2e8e1e0e2c2b/9b808177-78b5-575e-954f-2e8e1e0e2c2b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff4%252Fecf4d85f7201bb383996482691b84add%252Fpa%252FEZ95306_117fac6942e09eb450b922b6800f681c.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_117fac6942e09eb450b922b6800f681c.jpg saved to cache
2026-03-30 11:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b808177-78b5-575e-954f-2e8e1e0e2c2b
2026-03-30 11:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_881f3a73ffc364373be9fed3ef9286b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_6110abee2394ac0852aae750d6201560.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384b6210>
2026-03-30 11:16:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b808177-78b5-575e-954f-2e8e1e0e2c2b/9b808177-78b5-575e-954f-2e8e1e0e2c2b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff4%252Fecf4d85f7201bb383996482691b84add%252Fpa%252FEZ95306_e13a82acbf041ae86de08ccdb56449a4.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_e13a82acbf041ae86de08ccdb56449a4.jpg saved to cache
2026-03-30 11:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b808177-78b5-575e-954f-2e8e1e0e2c2b
2026-03-30 11:16:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07394126d0>
2026-03-30 11:16:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b808177-78b5-575e-954f-2e8e1e0e2c2b/9b808177-78b5-575e-954f-2e8e1e0e2c2b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff4%252Fecf4d85f7201bb383996482691b84add%252Fpa%252FEZ95306_881f3a73ffc364373be9fed3ef9286b6.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_881f3a73ffc364373be9fed3ef9286b6.jpg saved to cache
2026-03-30 11:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b808177-78b5-575e-954f-2e8e1e0e2c2b
2026-03-30 11:16:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073859d710>
2026-03-30 11:16:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b808177-78b5-575e-954f-2e8e1e0e2c2b/9b808177-78b5-575e-954f-2e8e1e0e2c2b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff4%252Fecf4d85f7201bb383996482691b84add%252Fpa%252FEZ95306_6110abee2394ac0852aae750d6201560.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_6110abee2394ac0852aae750d6201560.jpg saved to cache
2026-03-30 11:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b808177-78b5-575e-954f-2e8e1e0e2c2b
2026-03-30 11:16:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b808177-78b5-575e-954f-2e8e1e0e2c2b, skipping ID generation
2026-03-30 11:16:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b808177-78b5-575e-954f-2e8e1e0e2c2b with scrape type 1
2026-03-30 11:16:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b808177-78b5-575e-954f-2e8e1e0e2c2b sending to next pipeline
2026-03-30 11:16:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9b808177-78b5-575e-954f-2e8e1e0e2c2b, identifier: EZ95306
2026-03-30 11:16:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9b808177-78b5-575e-954f-2e8e1e0e2c2b with identifier: EZ95306
2026-03-30 11:16:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9b808177-78b5-575e-954f-2e8e1e0e2c2b with identifier: EZ95306
2026-03-30 11:16:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9b808177-78b5-575e-954f-2e8e1e0e2c2b with identifier: EZ95306 to the API
2026-03-30 11:16:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_6110abee2394ac0852aae750d6201560.jpg>
{'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:59:35Z',
'fuel_type': 'petrol',
'id': '9b808177-78b5-575e-954f-2e8e1e0e2c2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ95306',
'listing': 'auction',
'location': 'FR, La-Teste-de-Buch',
'make': 'MINI',
'model': 'MINI',
'odometer': 78975,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b808177-78b5-575e-954f-2e8e1e0e2c2b/9b808177-78b5-575e-954f-2e8e1e0e2c2b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72620,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_6110abee2394ac0852aae750d6201560.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b808177-78b5-575e-954f-2e8e1e0e2c2b/9b808177-78b5-575e-954f-2e8e1e0e2c2b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_881f3a73ffc364373be9fed3ef9286b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b808177-78b5-575e-954f-2e8e1e0e2c2b/9b808177-78b5-575e-954f-2e8e1e0e2c2b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71650,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_e13a82acbf041ae86de08ccdb56449a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b808177-78b5-575e-954f-2e8e1e0e2c2b/9b808177-78b5-575e-954f-2e8e1e0e2c2b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63837,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_117fac6942e09eb450b922b6800f681c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b808177-78b5-575e-954f-2e8e1e0e2c2b/9b808177-78b5-575e-954f-2e8e1e0e2c2b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68280,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_1a097043f1dfc03874c0f91245a8f906.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b808177-78b5-575e-954f-2e8e1e0e2c2b/9b808177-78b5-575e-954f-2e8e1e0e2c2b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_bb9f76761a5ae739a49202881533a2ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b808177-78b5-575e-954f-2e8e1e0e2c2b/9b808177-78b5-575e-954f-2e8e1e0e2c2b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_7831cce895160d9734a3b63d5f1dd290.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b808177-78b5-575e-954f-2e8e1e0e2c2b/9b808177-78b5-575e-954f-2e8e1e0e2c2b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_a40eb3e1ade239120ee7b6861cd4216f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b808177-78b5-575e-954f-2e8e1e0e2c2b/9b808177-78b5-575e-954f-2e8e1e0e2c2b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64156,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_fa874ffac9e636b473b9a8330ae45175.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b808177-78b5-575e-954f-2e8e1e0e2c2b/9b808177-78b5-575e-954f-2e8e1e0e2c2b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/f4/ecf4d85f7201bb383996482691b84add/pa/EZ95306_a5fd842eefc91116ecddfb110205ecf3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-04-26',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2026-03-30 11:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ95306%27 HTTP/1.1" 200 None
2026-03-30 11:16:18 [auto1.fr] INFO: Saving data for EZ95306: {'created_time': 1774869378.608371, 'last_price_update_time': 1774869378.608384, 'auction_closing_time': 1774972775.0}
2026-03-30 11:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EZ95306') HTTP/1.1" 204 0
2026-03-30 11:16:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA74710> (referer: https://www.auto1.com/v1/car-details-view/WA74710/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f71c55c9-2aa8-56a8-a2ad-edfe73063e08 with identifier: WA74710
2026-03-30 11:16:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f71c55c9-2aa8-56a8-a2ad-edfe73063e08 with scrape type 1
2026-03-30 11:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f71c55c9-2aa8-56a8-a2ad-edfe73063e08
2026-03-30 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46794df1a0dbad0f47a5eaf1223b5bbc%252Fpa%252FWA74710_2da6d67e6a47da24e9f01a45bcc8ba05.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_2da6d67e6a47da24e9f01a45bcc8ba05.jpg not downloaded yet
2026-03-30 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46794df1a0dbad0f47a5eaf1223b5bbc%252Fpa%252FWA74710_1247c79fdf0f2507488f0470adac0d53.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_1247c79fdf0f2507488f0470adac0d53.jpg not downloaded yet
2026-03-30 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46794df1a0dbad0f47a5eaf1223b5bbc%252Fpa%252FWA74710_96f8915ea443461c46aadf84b79f4637.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_96f8915ea443461c46aadf84b79f4637.jpg not downloaded yet
2026-03-30 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46794df1a0dbad0f47a5eaf1223b5bbc%252Fpa%252FWA74710_55964e70935b56239301d2c661e69bd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_55964e70935b56239301d2c661e69bd9.jpg not downloaded yet
2026-03-30 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46794df1a0dbad0f47a5eaf1223b5bbc%252Fpa%252FWA74710_60536e929d9ca408e7015852876361ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_60536e929d9ca408e7015852876361ea.jpg not downloaded yet
2026-03-30 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46794df1a0dbad0f47a5eaf1223b5bbc%252Fpa%252FWA74710_ab756a7d4f69b5cd517866c1286ca113.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_ab756a7d4f69b5cd517866c1286ca113.jpg not downloaded yet
2026-03-30 11:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:21 [auto1.fr] INFO: Channel: 24h | Page: 11 | totalHits: 5564 | hits on page: 40
2026-03-30 11:16:21 [auto1.fr] INFO: Found listing with ID: LK92723
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK92723%27 HTTP/1.1" 200 None
2026-03-30 11:16:21 [auto1.fr] INFO: Scrape type for LK92723: 0
2026-03-30 11:16:21 [auto1.fr] INFO: Found listing with ID: VJ96213
2026-03-30 11:16:21 [auto1.fr] INFO: Found listing with ID: RP51827
2026-03-30 11:16:21 [auto1.fr] INFO: Found listing with ID: PH85075
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH85075%27 HTTP/1.1" 200 None
2026-03-30 11:16:21 [auto1.fr] INFO: Scrape type for PH85075: 1
2026-03-30 11:16:21 [auto1.fr] INFO: Found listing with ID: XA18023
2026-03-30 11:16:21 [auto1.fr] INFO: Found listing with ID: HX86868
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX86868%27 HTTP/1.1" 200 None
2026-03-30 11:16:21 [auto1.fr] INFO: Scrape type for HX86868: 2
2026-03-30 11:16:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23032457-5f5a-5b20-b7fd-a909e93f37ad with identifier: HX86868
2026-03-30 11:16:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23032457-5f5a-5b20-b7fd-a909e93f37ad with scrape type 2
2026-03-30 11:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23032457-5f5a-5b20-b7fd-a909e93f37ad with scrape type 2
2026-03-30 11:16:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 23032457-5f5a-5b20-b7fd-a909e93f37ad, identifier: HX86868
2026-03-30 11:16:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 23032457-5f5a-5b20-b7fd-a909e93f37ad with identifier: HX86868
2026-03-30 11:16:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 23032457-5f5a-5b20-b7fd-a909e93f37ad with identifier: HX86868
2026-03-30 11:16:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 23032457-5f5a-5b20-b7fd-a909e93f37ad with identifier: HX86868 to the API
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:49:19Z',
'fuel_type': 'diesel',
'id': '23032457-5f5a-5b20-b7fd-a909e93f37ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX86868',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 273569,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-12',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Energy Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2019}
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX86868%27 HTTP/1.1" 200 None
2026-03-30 11:16:22 [auto1.fr] INFO: Saving data for HX86868: {'auction_closing_time': 1774972159.0, 'created_time': 1774015618.878445, 'last_price_update_time': 1774869382.161207}
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HX86868') HTTP/1.1" 204 0
2026-03-30 11:16:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_ab756a7d4f69b5cd517866c1286ca113.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:22 [auto1.fr] INFO: Found listing with ID: CX79974
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX79974%27 HTTP/1.1" 200 None
2026-03-30 11:16:22 [auto1.fr] INFO: Scrape type for CX79974: 1
2026-03-30 11:16:22 [auto1.fr] INFO: Found listing with ID: TK98013
2026-03-30 11:16:22 [auto1.fr] INFO: Found listing with ID: CB26112
2026-03-30 11:16:22 [auto1.fr] INFO: Found listing with ID: AM79434
2026-03-30 11:16:22 [auto1.fr] INFO: Found listing with ID: ES35993
2026-03-30 11:16:22 [auto1.fr] INFO: Found listing with ID: JT67860
2026-03-30 11:16:22 [auto1.fr] INFO: Found listing with ID: NK27352
2026-03-30 11:16:22 [auto1.fr] INFO: Found listing with ID: HN32336
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN32336%27 HTTP/1.1" 200 None
2026-03-30 11:16:22 [auto1.fr] INFO: Scrape type for HN32336: 1
2026-03-30 11:16:22 [auto1.fr] INFO: Found listing with ID: VH99245
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH99245%27 HTTP/1.1" 200 None
2026-03-30 11:16:22 [auto1.fr] INFO: Scrape type for VH99245: 2
2026-03-30 11:16:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59310fb3-96ec-5a66-b413-d852f57b923b with identifier: VH99245
2026-03-30 11:16:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59310fb3-96ec-5a66-b413-d852f57b923b with scrape type 2
2026-03-30 11:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59310fb3-96ec-5a66-b413-d852f57b923b with scrape type 2
2026-03-30 11:16:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 59310fb3-96ec-5a66-b413-d852f57b923b, identifier: VH99245
2026-03-30 11:16:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 59310fb3-96ec-5a66-b413-d852f57b923b with identifier: VH99245
2026-03-30 11:16:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 59310fb3-96ec-5a66-b413-d852f57b923b with identifier: VH99245
2026-03-30 11:16:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 59310fb3-96ec-5a66-b413-d852f57b923b with identifier: VH99245 to the API
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:43:07Z',
'fuel_type': 'diesel',
'id': '59310fb3-96ec-5a66-b413-d852f57b923b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH99245',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 129976,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-12-09',
'seller_name': None,
'title': 'Peugeot 308 1.6 HDi Feline',
'transmission': 'manual',
'trim': 'Feline',
'year': 2007}
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH99245%27 HTTP/1.1" 200 None
2026-03-30 11:16:22 [auto1.fr] INFO: Saving data for VH99245: {'auction_closing_time': 1774971787.0, 'created_time': 1774298360.760465, 'last_price_update_time': 1774869382.682891}
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VH99245') HTTP/1.1" 204 0
2026-03-30 11:16:22 [auto1.fr] INFO: Found listing with ID: WD02529
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD02529%27 HTTP/1.1" 200 None
2026-03-30 11:16:22 [auto1.fr] INFO: Scrape type for WD02529: 1
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073859fcd0>
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f71c55c9-2aa8-56a8-a2ad-edfe73063e08/f71c55c9-2aa8-56a8-a2ad-edfe73063e08_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46794df1a0dbad0f47a5eaf1223b5bbc%252Fpa%252FWA74710_ab756a7d4f69b5cd517866c1286ca113.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_ab756a7d4f69b5cd517866c1286ca113.jpg saved to cache
2026-03-30 11:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f71c55c9-2aa8-56a8-a2ad-edfe73063e08
2026-03-30 11:16:22 [auto1.fr] INFO: Found listing with ID: EP20272
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP20272%27 HTTP/1.1" 200 None
2026-03-30 11:16:22 [auto1.fr] INFO: Scrape type for EP20272: 2
2026-03-30 11:16:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe694b4c-326e-5811-b2a9-642c5e73124a with identifier: EP20272
2026-03-30 11:16:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe694b4c-326e-5811-b2a9-642c5e73124a with scrape type 2
2026-03-30 11:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe694b4c-326e-5811-b2a9-642c5e73124a with scrape type 2
2026-03-30 11:16:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fe694b4c-326e-5811-b2a9-642c5e73124a, identifier: EP20272
2026-03-30 11:16:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fe694b4c-326e-5811-b2a9-642c5e73124a with identifier: EP20272
2026-03-30 11:16:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fe694b4c-326e-5811-b2a9-642c5e73124a with identifier: EP20272
2026-03-30 11:16:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fe694b4c-326e-5811-b2a9-642c5e73124a with identifier: EP20272 to the API
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-31T15:38:53Z',
'fuel_type': 'diesel',
'id': 'fe694b4c-326e-5811-b2a9-642c5e73124a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP20272',
'listing': 'auction',
'make': 'Renault',
'model': 'Espace',
'odometer': 155453,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-30',
'seller_name': None,
'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2015}
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP20272%27 HTTP/1.1" 200 None
2026-03-30 11:16:23 [auto1.fr] INFO: Saving data for EP20272: {'auction_closing_time': 1774971533.0, 'created_time': 1774278865.622663, 'last_price_update_time': 1774869383.365392}
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EP20272') HTTP/1.1" 204 0
2026-03-30 11:16:23 [auto1.fr] INFO: Found listing with ID: VE02752
2026-03-30 11:16:23 [auto1.fr] INFO: Found listing with ID: AZ90567
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ90567%27 HTTP/1.1" 200 None
2026-03-30 11:16:23 [auto1.fr] INFO: Scrape type for AZ90567: 2
2026-03-30 11:16:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4969d600-6f0b-5d5e-8e83-0c46619a28e1 with identifier: AZ90567
2026-03-30 11:16:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4969d600-6f0b-5d5e-8e83-0c46619a28e1 with scrape type 2
2026-03-30 11:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4969d600-6f0b-5d5e-8e83-0c46619a28e1 with scrape type 2
2026-03-30 11:16:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4969d600-6f0b-5d5e-8e83-0c46619a28e1, identifier: AZ90567
2026-03-30 11:16:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4969d600-6f0b-5d5e-8e83-0c46619a28e1 with identifier: AZ90567
2026-03-30 11:16:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4969d600-6f0b-5d5e-8e83-0c46619a28e1 with identifier: AZ90567
2026-03-30 11:16:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4969d600-6f0b-5d5e-8e83-0c46619a28e1 with identifier: AZ90567 to the API
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:32:27Z',
'fuel_type': 'petrol',
'id': '4969d600-6f0b-5d5e-8e83-0c46619a28e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ90567',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 169261,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-29',
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2019}
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ90567%27 HTTP/1.1" 200 None
2026-03-30 11:16:23 [auto1.fr] INFO: Saving data for AZ90567: {'auction_closing_time': 1774971147.0, 'created_time': 1774298174.312028, 'last_price_update_time': 1774869383.788729}
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AZ90567') HTTP/1.1" 204 0
2026-03-30 11:16:23 [auto1.fr] INFO: Found listing with ID: CL47015
2026-03-30 11:16:23 [auto1.fr] INFO: Found listing with ID: KY03233
2026-03-30 11:16:23 [auto1.fr] INFO: Found listing with ID: CW40670
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW40670%27 HTTP/1.1" 200 None
2026-03-30 11:16:23 [auto1.fr] INFO: Scrape type for CW40670: 2
2026-03-30 11:16:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e91325e8-c122-56d2-85f1-c6dd0dcd7afa with identifier: CW40670
2026-03-30 11:16:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e91325e8-c122-56d2-85f1-c6dd0dcd7afa with scrape type 2
2026-03-30 11:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e91325e8-c122-56d2-85f1-c6dd0dcd7afa with scrape type 2
2026-03-30 11:16:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e91325e8-c122-56d2-85f1-c6dd0dcd7afa, identifier: CW40670
2026-03-30 11:16:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e91325e8-c122-56d2-85f1-c6dd0dcd7afa with identifier: CW40670
2026-03-30 11:16:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e91325e8-c122-56d2-85f1-c6dd0dcd7afa with identifier: CW40670
2026-03-30 11:16:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e91325e8-c122-56d2-85f1-c6dd0dcd7afa with identifier: CW40670 to the API
2026-03-30 11:16:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:02:56Z',
'fuel_type': 'petrol',
'id': 'e91325e8-c122-56d2-85f1-c6dd0dcd7afa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW40670',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 105093,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-08-29',
'seller_name': None,
'title': 'Peugeot 207 1.6 Sport Pack',
'transmission': 'manual',
'trim': 'Sport Pack',
'year': 2007}
2026-03-30 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW40670%27 HTTP/1.1" 200 None
2026-03-30 11:16:24 [auto1.fr] INFO: Saving data for CW40670: {'auction_closing_time': 1774969376.0, 'created_time': 1773660205.50437, 'last_price_update_time': 1774869384.554474}
2026-03-30 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CW40670') HTTP/1.1" 204 0
2026-03-30 11:16:24 [auto1.fr] INFO: Found listing with ID: JA68663
2026-03-30 11:16:24 [auto1.fr] INFO: Found listing with ID: EP13062
2026-03-30 11:16:24 [auto1.fr] INFO: Found listing with ID: KD39903
2026-03-30 11:16:24 [auto1.fr] INFO: Found listing with ID: GZ25721
2026-03-30 11:16:24 [auto1.fr] INFO: Found listing with ID: JU04159
2026-03-30 11:16:24 [auto1.fr] INFO: Found listing with ID: ES16654
2026-03-30 11:16:24 [auto1.fr] INFO: Found listing with ID: DE58917
2026-03-30 11:16:24 [auto1.fr] INFO: Found listing with ID: PY17725
2026-03-30 11:16:24 [auto1.fr] INFO: Found listing with ID: NW77264
2026-03-30 11:16:24 [auto1.fr] INFO: Found listing with ID: SG94624
2026-03-30 11:16:24 [auto1.fr] INFO: Found listing with ID: CL78536
2026-03-30 11:16:24 [auto1.fr] INFO: Found listing with ID: YF33503
2026-03-30 11:16:24 [auto1.fr] INFO: Found listing with ID: GF84131
2026-03-30 11:16:24 [auto1.fr] INFO: Found listing with ID: EZ54447
2026-03-30 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ54447%27 HTTP/1.1" 200 None
2026-03-30 11:16:24 [auto1.fr] INFO: Scrape type for EZ54447: 1
2026-03-30 11:16:24 [auto1.fr] INFO: Found listing with ID: EH19496
2026-03-30 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH19496%27 HTTP/1.1" 200 None
2026-03-30 11:16:24 [auto1.fr] INFO: Scrape type for EH19496: 1
2026-03-30 11:16:24 [auto1.fr] INFO: Found listing with ID: NL70342
2026-03-30 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL70342%27 HTTP/1.1" 200 None
2026-03-30 11:16:24 [auto1.fr] INFO: Scrape type for NL70342: 1
2026-03-30 11:16:24 [auto1.fr] INFO: Found listing with ID: YX07310
2026-03-30 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX07310%27 HTTP/1.1" 200 None
2026-03-30 11:16:24 [auto1.fr] INFO: Scrape type for YX07310: 1
2026-03-30 11:16:24 [auto1.fr] INFO: Found listing with ID: VX76381
2026-03-30 11:16:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GU57901> (referer: https://www.auto1.com/v1/car-details-view/GU57901/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91fb6dc1-2c05-55a2-be7c-4bfca9cff08d with identifier: GU57901
2026-03-30 11:16:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91fb6dc1-2c05-55a2-be7c-4bfca9cff08d with scrape type 1
2026-03-30 11:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91fb6dc1-2c05-55a2-be7c-4bfca9cff08d
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F82%252Fb7829c926925f102b63e895d6f993a4b%252Fpa%252FGU57901_a91b0f076adc027f0d9dca1177d98337.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_a91b0f076adc027f0d9dca1177d98337.jpg already downloaded
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F82%252Fb7829c926925f102b63e895d6f993a4b%252Fpa%252FGU57901_cc0f55d800f6de17748579fc760b6a20.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_cc0f55d800f6de17748579fc760b6a20.jpg already downloaded
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F82%252Fb7829c926925f102b63e895d6f993a4b%252Fpa%252FGU57901_1a1b9bdb42518a9b44ba883bf0b913ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_1a1b9bdb42518a9b44ba883bf0b913ce.jpg already downloaded
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F82%252Fb7829c926925f102b63e895d6f993a4b%252Fpa%252FGU57901_2adfc317581d855cdefd3ac091b8cd89.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_2adfc317581d855cdefd3ac091b8cd89.jpg already downloaded
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F82%252Fb7829c926925f102b63e895d6f993a4b%252Fpa%252FGU57901_bab9d90fb995a8c8c8d3c7e976be4a2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_bab9d90fb995a8c8c8d3c7e976be4a2c.jpg already downloaded
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F82%252Fb7829c926925f102b63e895d6f993a4b%252Fpa%252FGU57901_90f138ecbf53f5bb6ef683c8331778de.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_90f138ecbf53f5bb6ef683c8331778de.jpg already downloaded
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F82%252Fb7829c926925f102b63e895d6f993a4b%252Fpa%252FGU57901_f23ad18bfc0670f446da37440a0f48f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_f23ad18bfc0670f446da37440a0f48f0.jpg already downloaded
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F82%252Fb7829c926925f102b63e895d6f993a4b%252Fpa%252FGU57901_a913e1e48e048de9812cecf7d21a4a35.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_a913e1e48e048de9812cecf7d21a4a35.jpg already downloaded
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F82%252Fb7829c926925f102b63e895d6f993a4b%252Fpa%252FGU57901_c9f6118963d1c3713324516f25edda32.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_c9f6118963d1c3713324516f25edda32.jpg already downloaded
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F82%252Fb7829c926925f102b63e895d6f993a4b%252Fpa%252FGU57901_40e1b46df17e52b4f63759c16270042b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_40e1b46df17e52b4f63759c16270042b.jpg already downloaded
2026-03-30 11:16:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 91fb6dc1-2c05-55a2-be7c-4bfca9cff08d, identifier: GU57901
2026-03-30 11:16:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 91fb6dc1-2c05-55a2-be7c-4bfca9cff08d with identifier: GU57901
2026-03-30 11:16:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 91fb6dc1-2c05-55a2-be7c-4bfca9cff08d with identifier: GU57901
2026-03-30 11:16:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 91fb6dc1-2c05-55a2-be7c-4bfca9cff08d with identifier: GU57901 to the API
2026-03-30 11:16:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GU57901>
{'auction_title': '',
'c_o_2_emission_value': 157,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 185,
'expiration_date': '2026-03-31T15:34:49Z',
'fuel_type': 'petrol',
'id': '91fb6dc1-2c05-55a2-be7c-4bfca9cff08d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU57901',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'MINI',
'model': 'Countryman',
'odometer': 162026,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_a91b0f076adc027f0d9dca1177d98337.jpg',
'https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_cc0f55d800f6de17748579fc760b6a20.jpg',
'https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_1a1b9bdb42518a9b44ba883bf0b913ce.jpg',
'https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_2adfc317581d855cdefd3ac091b8cd89.jpg',
'https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_bab9d90fb995a8c8c8d3c7e976be4a2c.jpg',
'https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_90f138ecbf53f5bb6ef683c8331778de.jpg',
'https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_f23ad18bfc0670f446da37440a0f48f0.jpg',
'https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_a913e1e48e048de9812cecf7d21a4a35.jpg',
'https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_c9f6118963d1c3713324516f25edda32.jpg',
'https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_40e1b46df17e52b4f63759c16270042b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fb6dc1-2c05-55a2-be7c-4bfca9cff08d/91fb6dc1-2c05-55a2-be7c-4bfca9cff08d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_a91b0f076adc027f0d9dca1177d98337.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fb6dc1-2c05-55a2-be7c-4bfca9cff08d/91fb6dc1-2c05-55a2-be7c-4bfca9cff08d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79731,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_cc0f55d800f6de17748579fc760b6a20.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fb6dc1-2c05-55a2-be7c-4bfca9cff08d/91fb6dc1-2c05-55a2-be7c-4bfca9cff08d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76617,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_1a1b9bdb42518a9b44ba883bf0b913ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fb6dc1-2c05-55a2-be7c-4bfca9cff08d/91fb6dc1-2c05-55a2-be7c-4bfca9cff08d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2737767,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_2adfc317581d855cdefd3ac091b8cd89.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fb6dc1-2c05-55a2-be7c-4bfca9cff08d/91fb6dc1-2c05-55a2-be7c-4bfca9cff08d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75321,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_bab9d90fb995a8c8c8d3c7e976be4a2c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fb6dc1-2c05-55a2-be7c-4bfca9cff08d/91fb6dc1-2c05-55a2-be7c-4bfca9cff08d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82077,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_90f138ecbf53f5bb6ef683c8331778de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fb6dc1-2c05-55a2-be7c-4bfca9cff08d/91fb6dc1-2c05-55a2-be7c-4bfca9cff08d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63298,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_f23ad18bfc0670f446da37440a0f48f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fb6dc1-2c05-55a2-be7c-4bfca9cff08d/91fb6dc1-2c05-55a2-be7c-4bfca9cff08d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_a913e1e48e048de9812cecf7d21a4a35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fb6dc1-2c05-55a2-be7c-4bfca9cff08d/91fb6dc1-2c05-55a2-be7c-4bfca9cff08d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77130,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_c9f6118963d1c3713324516f25edda32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fb6dc1-2c05-55a2-be7c-4bfca9cff08d/91fb6dc1-2c05-55a2-be7c-4bfca9cff08d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71657,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/82/b7829c926925f102b63e895d6f993a4b/pa/GU57901_40e1b46df17e52b4f63759c16270042b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman Cooper S ALL4',
'transmission': 'manual',
'trim': 'ALL4',
'year': 2012}
2026-03-30 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU57901%27 HTTP/1.1" 200 None
2026-03-30 11:16:30 [auto1.fr] INFO: Saving data for GU57901: {'created_time': 1774869390.17158, 'last_price_update_time': 1774869390.171592, 'auction_closing_time': 1774971289.0}
2026-03-30 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GU57901') HTTP/1.1" 204 0
2026-03-30 11:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ86489/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:36 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.964(s), this was the 1st time calling it.
2026-03-30 11:16:36 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.531958056922869 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:16:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PB55961/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:16:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UV64510/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF41129> (referer: https://www.auto1.com/v1/car-details-view/DF41129/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81 with identifier: DF41129
2026-03-30 11:16:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81 with scrape type 1
2026-03-30 11:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81
2026-03-30 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F7b%252F537b98f341d9da29565e8be0bd41516c%252Fpa%252FDF41129_369d17e72ce207a47ddf74a187970677.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_369d17e72ce207a47ddf74a187970677.jpg not downloaded yet
2026-03-30 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F7b%252F537b98f341d9da29565e8be0bd41516c%252Fpa%252FDF41129_d13c3fcf11a55a0848fb995d782ea24b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_d13c3fcf11a55a0848fb995d782ea24b.jpg not downloaded yet
2026-03-30 11:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG92938> (referer: https://www.auto1.com/v1/car-details-view/LG92938/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F7b%252F537b98f341d9da29565e8be0bd41516c%252Fpa%252FDF41129_fb7e8a555b87192b561c583ebcc5ffd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_fb7e8a555b87192b561c583ebcc5ffd9.jpg not downloaded yet
2026-03-30 11:16:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F7b%252F537b98f341d9da29565e8be0bd41516c%252Fpa%252FDF41129_9553d4d098e6b46950a48670e2a2f8f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_9553d4d098e6b46950a48670e2a2f8f0.jpg not downloaded yet
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F7b%252F537b98f341d9da29565e8be0bd41516c%252Fpa%252FDF41129_0902210baf1c0616637f33e39cf24510.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_0902210baf1c0616637f33e39cf24510.jpg not downloaded yet
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F7b%252F537b98f341d9da29565e8be0bd41516c%252Fpa%252FDF41129_99d38308517879b2b85d3196fa5627e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_99d38308517879b2b85d3196fa5627e9.jpg not downloaded yet
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F7b%252F537b98f341d9da29565e8be0bd41516c%252Fpa%252FDF41129_b1bee67f512e5703e1b199fa6675dd27.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_b1bee67f512e5703e1b199fa6675dd27.jpg not downloaded yet
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F7b%252F537b98f341d9da29565e8be0bd41516c%252Fpa%252FDF41129_b78ea7f0a43df892c17eeebae866626a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_b78ea7f0a43df892c17eeebae866626a.jpg not downloaded yet
2026-03-30 11:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_d13c3fcf11a55a0848fb995d782ea24b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F7b%252F537b98f341d9da29565e8be0bd41516c%252Fpa%252FDF41129_f7ac5c89cd0e90d615408a04f7418c2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_f7ac5c89cd0e90d615408a04f7418c2d.jpg not downloaded yet
2026-03-30 11:16:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 877afe2c-4320-50fe-8135-1f8bea634755 with identifier: LG92938
2026-03-30 11:16:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 877afe2c-4320-50fe-8135-1f8bea634755 with scrape type 1
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 877afe2c-4320-50fe-8135-1f8bea634755
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F34%252F2b34a9d37921241b133135e26fb69fb1%252Fpa%252FLG92938_95fa32ee4131392451ad61c2732eeb03.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_95fa32ee4131392451ad61c2732eeb03.jpg not downloaded yet
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F7b%252F537b98f341d9da29565e8be0bd41516c%252Fpa%252FDF41129_68015890bf0781ddba7dbaa20039c8ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_68015890bf0781ddba7dbaa20039c8ca.jpg not downloaded yet
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F34%252F2b34a9d37921241b133135e26fb69fb1%252Fpa%252FLG92938_cafae2afb088ba43f5945fcba5c5121c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_cafae2afb088ba43f5945fcba5c5121c.jpg not downloaded yet
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F34%252F2b34a9d37921241b133135e26fb69fb1%252Fpa%252FLG92938_b62541c69ebcdc8d94e1295347ce4e7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_b62541c69ebcdc8d94e1295347ce4e7b.jpg not downloaded yet
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F34%252F2b34a9d37921241b133135e26fb69fb1%252Fpa%252FLG92938_f0c0a5c4ec6f7a3f97445e22d574d21a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_f0c0a5c4ec6f7a3f97445e22d574d21a.jpg not downloaded yet
2026-03-30 11:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_b78ea7f0a43df892c17eeebae866626a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F34%252F2b34a9d37921241b133135e26fb69fb1%252Fpa%252FLG92938_e2add5359255e90e3f37b85a7500238f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_e2add5359255e90e3f37b85a7500238f.jpg not downloaded yet
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F34%252F2b34a9d37921241b133135e26fb69fb1%252Fpa%252FLG92938_26301107ea09b45bff0956056aa1044c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_26301107ea09b45bff0956056aa1044c.jpg not downloaded yet
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a513e10>
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81/e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F7b%252F537b98f341d9da29565e8be0bd41516c%252Fpa%252FDF41129_d13c3fcf11a55a0848fb995d782ea24b.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_d13c3fcf11a55a0848fb995d782ea24b.jpg saved to cache
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81
2026-03-30 11:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_f0c0a5c4ec6f7a3f97445e22d574d21a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a4fe910>
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81/e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F7b%252F537b98f341d9da29565e8be0bd41516c%252Fpa%252FDF41129_b78ea7f0a43df892c17eeebae866626a.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_b78ea7f0a43df892c17eeebae866626a.jpg saved to cache
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81
2026-03-30 11:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_26301107ea09b45bff0956056aa1044c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07393f4e50>
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_877afe2c-4320-50fe-8135-1f8bea634755/877afe2c-4320-50fe-8135-1f8bea634755_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F34%252F2b34a9d37921241b133135e26fb69fb1%252Fpa%252FLG92938_f0c0a5c4ec6f7a3f97445e22d574d21a.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_f0c0a5c4ec6f7a3f97445e22d574d21a.jpg saved to cache
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 877afe2c-4320-50fe-8135-1f8bea634755
2026-03-30 11:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_e2add5359255e90e3f37b85a7500238f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738609a10>
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_877afe2c-4320-50fe-8135-1f8bea634755/877afe2c-4320-50fe-8135-1f8bea634755_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F34%252F2b34a9d37921241b133135e26fb69fb1%252Fpa%252FLG92938_26301107ea09b45bff0956056aa1044c.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_26301107ea09b45bff0956056aa1044c.jpg saved to cache
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 877afe2c-4320-50fe-8135-1f8bea634755
2026-03-30 11:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_b62541c69ebcdc8d94e1295347ce4e7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_cafae2afb088ba43f5945fcba5c5121c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073875ddd0>
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_877afe2c-4320-50fe-8135-1f8bea634755/877afe2c-4320-50fe-8135-1f8bea634755_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F34%252F2b34a9d37921241b133135e26fb69fb1%252Fpa%252FLG92938_e2add5359255e90e3f37b85a7500238f.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_e2add5359255e90e3f37b85a7500238f.jpg saved to cache
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 877afe2c-4320-50fe-8135-1f8bea634755
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073859f950>
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_877afe2c-4320-50fe-8135-1f8bea634755/877afe2c-4320-50fe-8135-1f8bea634755_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F34%252F2b34a9d37921241b133135e26fb69fb1%252Fpa%252FLG92938_b62541c69ebcdc8d94e1295347ce4e7b.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_b62541c69ebcdc8d94e1295347ce4e7b.jpg saved to cache
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 877afe2c-4320-50fe-8135-1f8bea634755
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073860ae90>
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_877afe2c-4320-50fe-8135-1f8bea634755/877afe2c-4320-50fe-8135-1f8bea634755_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F34%252F2b34a9d37921241b133135e26fb69fb1%252Fpa%252FLG92938_cafae2afb088ba43f5945fcba5c5121c.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_cafae2afb088ba43f5945fcba5c5121c.jpg saved to cache
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 877afe2c-4320-50fe-8135-1f8bea634755
2026-03-30 11:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_68015890bf0781ddba7dbaa20039c8ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_95fa32ee4131392451ad61c2732eeb03.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_f7ac5c89cd0e90d615408a04f7418c2d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385ddf50>
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81/e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F7b%252F537b98f341d9da29565e8be0bd41516c%252Fpa%252FDF41129_68015890bf0781ddba7dbaa20039c8ca.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_68015890bf0781ddba7dbaa20039c8ca.jpg saved to cache
2026-03-30 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738707090>
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_877afe2c-4320-50fe-8135-1f8bea634755/877afe2c-4320-50fe-8135-1f8bea634755_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F34%252F2b34a9d37921241b133135e26fb69fb1%252Fpa%252FLG92938_95fa32ee4131392451ad61c2732eeb03.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_95fa32ee4131392451ad61c2732eeb03.jpg saved to cache
2026-03-30 11:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 877afe2c-4320-50fe-8135-1f8bea634755
2026-03-30 11:16:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 877afe2c-4320-50fe-8135-1f8bea634755, skipping ID generation
2026-03-30 11:16:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 877afe2c-4320-50fe-8135-1f8bea634755 with scrape type 1
2026-03-30 11:16:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 877afe2c-4320-50fe-8135-1f8bea634755 sending to next pipeline
2026-03-30 11:16:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 877afe2c-4320-50fe-8135-1f8bea634755, identifier: LG92938
2026-03-30 11:16:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 877afe2c-4320-50fe-8135-1f8bea634755 with identifier: LG92938
2026-03-30 11:16:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 877afe2c-4320-50fe-8135-1f8bea634755 with identifier: LG92938
2026-03-30 11:16:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 877afe2c-4320-50fe-8135-1f8bea634755 with identifier: LG92938 to the API
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_95fa32ee4131392451ad61c2732eeb03.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:46:10Z',
'fuel_type': 'diesel',
'id': '877afe2c-4320-50fe-8135-1f8bea634755',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG92938',
'listing': 'auction',
'location': 'FR, Vénissieux',
'make': 'Nissan',
'model': 'Juke',
'odometer': 237547,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_877afe2c-4320-50fe-8135-1f8bea634755/877afe2c-4320-50fe-8135-1f8bea634755_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86305,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_95fa32ee4131392451ad61c2732eeb03.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_877afe2c-4320-50fe-8135-1f8bea634755/877afe2c-4320-50fe-8135-1f8bea634755_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94906,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_cafae2afb088ba43f5945fcba5c5121c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_877afe2c-4320-50fe-8135-1f8bea634755/877afe2c-4320-50fe-8135-1f8bea634755_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64284,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_b62541c69ebcdc8d94e1295347ce4e7b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_877afe2c-4320-50fe-8135-1f8bea634755/877afe2c-4320-50fe-8135-1f8bea634755_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68038,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_f0c0a5c4ec6f7a3f97445e22d574d21a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_877afe2c-4320-50fe-8135-1f8bea634755/877afe2c-4320-50fe-8135-1f8bea634755_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83563,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_e2add5359255e90e3f37b85a7500238f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_877afe2c-4320-50fe-8135-1f8bea634755/877afe2c-4320-50fe-8135-1f8bea634755_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41275,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/34/2b34a9d37921241b133135e26fb69fb1/pa/LG92938_26301107ea09b45bff0956056aa1044c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-08-28',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Juke 1.5 Turbodiesel Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2011}
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG92938%27 HTTP/1.1" 200 None
2026-03-30 11:16:48 [auto1.fr] INFO: Saving data for LG92938: {'created_time': 1774869408.556842, 'last_price_update_time': 1774869408.556856, 'auction_closing_time': 1774971970.0}
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LG92938') HTTP/1.1" 204 0
2026-03-30 11:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_b1bee67f512e5703e1b199fa6675dd27.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383b1510>
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81/e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F7b%252F537b98f341d9da29565e8be0bd41516c%252Fpa%252FDF41129_f7ac5c89cd0e90d615408a04f7418c2d.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_f7ac5c89cd0e90d615408a04f7418c2d.jpg saved to cache
2026-03-30 11:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073860d3d0>
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81/e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F7b%252F537b98f341d9da29565e8be0bd41516c%252Fpa%252FDF41129_b1bee67f512e5703e1b199fa6675dd27.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_b1bee67f512e5703e1b199fa6675dd27.jpg saved to cache
2026-03-30 11:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81
2026-03-30 11:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_99d38308517879b2b85d3196fa5627e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_0902210baf1c0616637f33e39cf24510.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_9553d4d098e6b46950a48670e2a2f8f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738727710>
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81/e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F7b%252F537b98f341d9da29565e8be0bd41516c%252Fpa%252FDF41129_99d38308517879b2b85d3196fa5627e9.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_99d38308517879b2b85d3196fa5627e9.jpg saved to cache
2026-03-30 11:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81
2026-03-30 11:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_fb7e8a555b87192b561c583ebcc5ffd9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073868ff10>
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81/e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F7b%252F537b98f341d9da29565e8be0bd41516c%252Fpa%252FDF41129_0902210baf1c0616637f33e39cf24510.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_0902210baf1c0616637f33e39cf24510.jpg saved to cache
2026-03-30 11:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81
2026-03-30 11:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_369d17e72ce207a47ddf74a187970677.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384b1690>
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81/e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F7b%252F537b98f341d9da29565e8be0bd41516c%252Fpa%252FDF41129_9553d4d098e6b46950a48670e2a2f8f0.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_9553d4d098e6b46950a48670e2a2f8f0.jpg saved to cache
2026-03-30 11:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738726d90>
2026-03-30 11:16:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81/e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F7b%252F537b98f341d9da29565e8be0bd41516c%252Fpa%252FDF41129_fb7e8a555b87192b561c583ebcc5ffd9.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_fb7e8a555b87192b561c583ebcc5ffd9.jpg saved to cache
2026-03-30 11:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81
2026-03-30 11:16:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384c3f10>
2026-03-30 11:16:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81/e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F7b%252F537b98f341d9da29565e8be0bd41516c%252Fpa%252FDF41129_369d17e72ce207a47ddf74a187970677.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_369d17e72ce207a47ddf74a187970677.jpg saved to cache
2026-03-30 11:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81
2026-03-30 11:16:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81, skipping ID generation
2026-03-30 11:16:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81 with scrape type 1
2026-03-30 11:16:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81 sending to next pipeline
2026-03-30 11:16:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81, identifier: DF41129
2026-03-30 11:16:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81 with identifier: DF41129
2026-03-30 11:16:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81 with identifier: DF41129
2026-03-30 11:16:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81 with identifier: DF41129 to the API
2026-03-30 11:16:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_369d17e72ce207a47ddf74a187970677.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:13:06Z',
'fuel_type': 'petrol',
'id': 'e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF41129',
'listing': 'auction',
'location': 'FR, Orgeval',
'make': 'Renault',
'model': 'Clio',
'odometer': 48239,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81/e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61556,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_369d17e72ce207a47ddf74a187970677.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81/e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_d13c3fcf11a55a0848fb995d782ea24b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81/e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63246,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_fb7e8a555b87192b561c583ebcc5ffd9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81/e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62915,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_9553d4d098e6b46950a48670e2a2f8f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81/e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55677,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_0902210baf1c0616637f33e39cf24510.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81/e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_99d38308517879b2b85d3196fa5627e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81/e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41154,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_b1bee67f512e5703e1b199fa6675dd27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81/e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42963,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_b78ea7f0a43df892c17eeebae866626a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81/e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49074,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_f7ac5c89cd0e90d615408a04f7418c2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81/e0cb42f0-c7d1-5c52-b1e2-25bcf33dde81_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51850,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/7b/537b98f341d9da29565e8be0bd41516c/pa/DF41129_68015890bf0781ddba7dbaa20039c8ca.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.0 TCe Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2020}
2026-03-30 11:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DF41129%27 HTTP/1.1" 200 None
2026-03-30 11:16:49 [auto1.fr] INFO: Saving data for DF41129: {'created_time': 1774869409.513555, 'last_price_update_time': 1774869409.513566, 'auction_closing_time': 1774969986.0}
2026-03-30 11:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DF41129') HTTP/1.1" 204 0
2026-03-30 11:16:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ51086/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FS93369> (referer: https://www.auto1.com/v1/car-details-view/FS93369/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f6ab7a2-9567-53af-b30f-b7a641b95e07 with identifier: FS93369
2026-03-30 11:16:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f6ab7a2-9567-53af-b30f-b7a641b95e07 with scrape type 1
2026-03-30 11:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f6ab7a2-9567-53af-b30f-b7a641b95e07
2026-03-30 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa997d96351f9b25f8e8147ad8ac5c688%252Fpa%252FFS93369_3cab43a84a0d65f881b7256f3b016090.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_3cab43a84a0d65f881b7256f3b016090.jpg not downloaded yet
2026-03-30 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa997d96351f9b25f8e8147ad8ac5c688%252Fpa%252FFS93369_0f58cf332abd2f002ce5fd2ea56b5c5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_0f58cf332abd2f002ce5fd2ea56b5c5c.jpg not downloaded yet
2026-03-30 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa997d96351f9b25f8e8147ad8ac5c688%252Fpa%252FFS93369_6cc7530ad8f06c9e774de4f0239a2600.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_6cc7530ad8f06c9e774de4f0239a2600.jpg not downloaded yet
2026-03-30 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa997d96351f9b25f8e8147ad8ac5c688%252Fpa%252FFS93369_bde913f4ad05a982e3827018aacf6765.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_bde913f4ad05a982e3827018aacf6765.jpg not downloaded yet
2026-03-30 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa997d96351f9b25f8e8147ad8ac5c688%252Fpa%252FFS93369_046b01611e7547bc0f2695e855881508.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_046b01611e7547bc0f2695e855881508.jpg not downloaded yet
2026-03-30 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa997d96351f9b25f8e8147ad8ac5c688%252Fpa%252FFS93369_ef9b8a9a545c6576a4fd548965827077.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_ef9b8a9a545c6576a4fd548965827077.jpg not downloaded yet
2026-03-30 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa997d96351f9b25f8e8147ad8ac5c688%252Fpa%252FFS93369_97cb265b927a4f41e2c409619c05fc46.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_97cb265b927a4f41e2c409619c05fc46.jpg not downloaded yet
2026-03-30 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa997d96351f9b25f8e8147ad8ac5c688%252Fpa%252FFS93369_be57de8b647c3dce9e9eac65e2911825.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_be57de8b647c3dce9e9eac65e2911825.jpg not downloaded yet
2026-03-30 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa997d96351f9b25f8e8147ad8ac5c688%252Fpa%252FFS93369_8dc09e3a2f46f1e77a48c59ff39cc128.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_8dc09e3a2f46f1e77a48c59ff39cc128.jpg not downloaded yet
2026-03-30 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa997d96351f9b25f8e8147ad8ac5c688%252Fpa%252FFS93369_3914b518b3d5cd9683de4a011aa64c5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_3914b518b3d5cd9683de4a011aa64c5c.jpg not downloaded yet
2026-03-30 11:16:59 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.097(s), this was the 1st time calling it.
2026-03-30 11:16:59 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.546954704319339 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:17:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ND41633/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_3914b518b3d5cd9683de4a011aa64c5c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_8dc09e3a2f46f1e77a48c59ff39cc128.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:17:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385622d0>
2026-03-30 11:17:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6ab7a2-9567-53af-b30f-b7a641b95e07/8f6ab7a2-9567-53af-b30f-b7a641b95e07_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa997d96351f9b25f8e8147ad8ac5c688%252Fpa%252FFS93369_3914b518b3d5cd9683de4a011aa64c5c.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_3914b518b3d5cd9683de4a011aa64c5c.jpg saved to cache
2026-03-30 11:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f6ab7a2-9567-53af-b30f-b7a641b95e07
2026-03-30 11:17:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738560310>
2026-03-30 11:17:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6ab7a2-9567-53af-b30f-b7a641b95e07/8f6ab7a2-9567-53af-b30f-b7a641b95e07_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa997d96351f9b25f8e8147ad8ac5c688%252Fpa%252FFS93369_8dc09e3a2f46f1e77a48c59ff39cc128.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_8dc09e3a2f46f1e77a48c59ff39cc128.jpg saved to cache
2026-03-30 11:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f6ab7a2-9567-53af-b30f-b7a641b95e07
2026-03-30 11:17:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VT02723/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_be57de8b647c3dce9e9eac65e2911825.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_97cb265b927a4f41e2c409619c05fc46.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385bff50>
2026-03-30 11:17:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6ab7a2-9567-53af-b30f-b7a641b95e07/8f6ab7a2-9567-53af-b30f-b7a641b95e07_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa997d96351f9b25f8e8147ad8ac5c688%252Fpa%252FFS93369_be57de8b647c3dce9e9eac65e2911825.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_be57de8b647c3dce9e9eac65e2911825.jpg saved to cache
2026-03-30 11:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f6ab7a2-9567-53af-b30f-b7a641b95e07
2026-03-30 11:17:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383b24d0>
2026-03-30 11:17:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6ab7a2-9567-53af-b30f-b7a641b95e07/8f6ab7a2-9567-53af-b30f-b7a641b95e07_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa997d96351f9b25f8e8147ad8ac5c688%252Fpa%252FFS93369_97cb265b927a4f41e2c409619c05fc46.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_97cb265b927a4f41e2c409619c05fc46.jpg saved to cache
2026-03-30 11:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f6ab7a2-9567-53af-b30f-b7a641b95e07
2026-03-30 11:17:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_ef9b8a9a545c6576a4fd548965827077.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384c0c10>
2026-03-30 11:17:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6ab7a2-9567-53af-b30f-b7a641b95e07/8f6ab7a2-9567-53af-b30f-b7a641b95e07_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa997d96351f9b25f8e8147ad8ac5c688%252Fpa%252FFS93369_ef9b8a9a545c6576a4fd548965827077.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_ef9b8a9a545c6576a4fd548965827077.jpg saved to cache
2026-03-30 11:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f6ab7a2-9567-53af-b30f-b7a641b95e07
2026-03-30 11:17:05 [scrapy.extensions.logstats] INFO: Crawled 94 pages (at 13 pages/min), scraped 83 items (at 10 items/min)
2026-03-30 11:17:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH85075/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_046b01611e7547bc0f2695e855881508.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383b1950>
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6ab7a2-9567-53af-b30f-b7a641b95e07/8f6ab7a2-9567-53af-b30f-b7a641b95e07_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa997d96351f9b25f8e8147ad8ac5c688%252Fpa%252FFS93369_046b01611e7547bc0f2695e855881508.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_046b01611e7547bc0f2695e855881508.jpg saved to cache
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f6ab7a2-9567-53af-b30f-b7a641b95e07
2026-03-30 11:17:11 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.341(s), this was the 2nd time calling it.
2026-03-30 11:17:11 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.034498720908584 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:17:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:17:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UH12185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_bde913f4ad05a982e3827018aacf6765.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738782210>
2026-03-30 11:17:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6ab7a2-9567-53af-b30f-b7a641b95e07/8f6ab7a2-9567-53af-b30f-b7a641b95e07_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa997d96351f9b25f8e8147ad8ac5c688%252Fpa%252FFS93369_bde913f4ad05a982e3827018aacf6765.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_bde913f4ad05a982e3827018aacf6765.jpg saved to cache
2026-03-30 11:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f6ab7a2-9567-53af-b30f-b7a641b95e07
2026-03-30 11:17:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PB55961> (referer: https://www.auto1.com/v1/car-details-view/PB55961/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_6cc7530ad8f06c9e774de4f0239a2600.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa167e4a-2160-5c49-9e91-173599ad1699 with identifier: PB55961
2026-03-30 11:17:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa167e4a-2160-5c49-9e91-173599ad1699 with scrape type 1
2026-03-30 11:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item fa167e4a-2160-5c49-9e91-173599ad1699
2026-03-30 11:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F33%252Fd0333bb83bbab5f309fd993ef542cb16%252Fpa%252FPB55961_2f6e178eeb6a2034a39b775964c21058.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_2f6e178eeb6a2034a39b775964c21058.jpg not downloaded yet
2026-03-30 11:17:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_0f58cf332abd2f002ce5fd2ea56b5c5c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F33%252Fd0333bb83bbab5f309fd993ef542cb16%252Fpa%252FPB55961_5d6289294269372f69df74eb6aa73d04.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_5d6289294269372f69df74eb6aa73d04.jpg not downloaded yet
2026-03-30 11:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F33%252Fd0333bb83bbab5f309fd993ef542cb16%252Fpa%252FPB55961_881c1a824fd84e2cc68b181bb8b71c61.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_881c1a824fd84e2cc68b181bb8b71c61.jpg not downloaded yet
2026-03-30 11:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F33%252Fd0333bb83bbab5f309fd993ef542cb16%252Fpa%252FPB55961_42a36f6e6db6acd20b69bfe4ebf77343.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_42a36f6e6db6acd20b69bfe4ebf77343.jpg not downloaded yet
2026-03-30 11:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F33%252Fd0333bb83bbab5f309fd993ef542cb16%252Fpa%252FPB55961_38ff96afe6af417e7a3d5f0c73522179.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_38ff96afe6af417e7a3d5f0c73522179.jpg not downloaded yet
2026-03-30 11:17:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384c1150>
2026-03-30 11:17:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6ab7a2-9567-53af-b30f-b7a641b95e07/8f6ab7a2-9567-53af-b30f-b7a641b95e07_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa997d96351f9b25f8e8147ad8ac5c688%252Fpa%252FFS93369_6cc7530ad8f06c9e774de4f0239a2600.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_6cc7530ad8f06c9e774de4f0239a2600.jpg saved to cache
2026-03-30 11:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f6ab7a2-9567-53af-b30f-b7a641b95e07
2026-03-30 11:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F33%252Fd0333bb83bbab5f309fd993ef542cb16%252Fpa%252FPB55961_6f209d0d2083a3558291cb1dee94492a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_6f209d0d2083a3558291cb1dee94492a.jpg not downloaded yet
2026-03-30 11:17:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_2f6e178eeb6a2034a39b775964c21058.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073875eed0>
2026-03-30 11:17:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6ab7a2-9567-53af-b30f-b7a641b95e07/8f6ab7a2-9567-53af-b30f-b7a641b95e07_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa997d96351f9b25f8e8147ad8ac5c688%252Fpa%252FFS93369_0f58cf332abd2f002ce5fd2ea56b5c5c.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_0f58cf332abd2f002ce5fd2ea56b5c5c.jpg saved to cache
2026-03-30 11:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f6ab7a2-9567-53af-b30f-b7a641b95e07
2026-03-30 11:17:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_38ff96afe6af417e7a3d5f0c73522179.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_6f209d0d2083a3558291cb1dee94492a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073867e210>
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa167e4a-2160-5c49-9e91-173599ad1699/fa167e4a-2160-5c49-9e91-173599ad1699_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F33%252Fd0333bb83bbab5f309fd993ef542cb16%252Fpa%252FPB55961_2f6e178eeb6a2034a39b775964c21058.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_2f6e178eeb6a2034a39b775964c21058.jpg saved to cache
2026-03-30 11:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa167e4a-2160-5c49-9e91-173599ad1699
2026-03-30 11:17:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_42a36f6e6db6acd20b69bfe4ebf77343.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384dad50>
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa167e4a-2160-5c49-9e91-173599ad1699/fa167e4a-2160-5c49-9e91-173599ad1699_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F33%252Fd0333bb83bbab5f309fd993ef542cb16%252Fpa%252FPB55961_38ff96afe6af417e7a3d5f0c73522179.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_38ff96afe6af417e7a3d5f0c73522179.jpg saved to cache
2026-03-30 11:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa167e4a-2160-5c49-9e91-173599ad1699
2026-03-30 11:17:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_881c1a824fd84e2cc68b181bb8b71c61.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384db050>
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa167e4a-2160-5c49-9e91-173599ad1699/fa167e4a-2160-5c49-9e91-173599ad1699_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F33%252Fd0333bb83bbab5f309fd993ef542cb16%252Fpa%252FPB55961_6f209d0d2083a3558291cb1dee94492a.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_6f209d0d2083a3558291cb1dee94492a.jpg saved to cache
2026-03-30 11:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa167e4a-2160-5c49-9e91-173599ad1699
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738774210>
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa167e4a-2160-5c49-9e91-173599ad1699/fa167e4a-2160-5c49-9e91-173599ad1699_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F33%252Fd0333bb83bbab5f309fd993ef542cb16%252Fpa%252FPB55961_42a36f6e6db6acd20b69bfe4ebf77343.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_42a36f6e6db6acd20b69bfe4ebf77343.jpg saved to cache
2026-03-30 11:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa167e4a-2160-5c49-9e91-173599ad1699
2026-03-30 11:17:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_5d6289294269372f69df74eb6aa73d04.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385be1d0>
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa167e4a-2160-5c49-9e91-173599ad1699/fa167e4a-2160-5c49-9e91-173599ad1699_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F33%252Fd0333bb83bbab5f309fd993ef542cb16%252Fpa%252FPB55961_881c1a824fd84e2cc68b181bb8b71c61.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_881c1a824fd84e2cc68b181bb8b71c61.jpg saved to cache
2026-03-30 11:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa167e4a-2160-5c49-9e91-173599ad1699
2026-03-30 11:17:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_3cab43a84a0d65f881b7256f3b016090.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07387263d0>
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa167e4a-2160-5c49-9e91-173599ad1699/fa167e4a-2160-5c49-9e91-173599ad1699_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F33%252Fd0333bb83bbab5f309fd993ef542cb16%252Fpa%252FPB55961_5d6289294269372f69df74eb6aa73d04.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_5d6289294269372f69df74eb6aa73d04.jpg saved to cache
2026-03-30 11:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa167e4a-2160-5c49-9e91-173599ad1699
2026-03-30 11:17:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa167e4a-2160-5c49-9e91-173599ad1699, skipping ID generation
2026-03-30 11:17:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa167e4a-2160-5c49-9e91-173599ad1699 with scrape type 1
2026-03-30 11:17:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa167e4a-2160-5c49-9e91-173599ad1699 sending to next pipeline
2026-03-30 11:17:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fa167e4a-2160-5c49-9e91-173599ad1699, identifier: PB55961
2026-03-30 11:17:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fa167e4a-2160-5c49-9e91-173599ad1699 with identifier: PB55961
2026-03-30 11:17:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fa167e4a-2160-5c49-9e91-173599ad1699 with identifier: PB55961
2026-03-30 11:17:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fa167e4a-2160-5c49-9e91-173599ad1699 with identifier: PB55961 to the API
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_5d6289294269372f69df74eb6aa73d04.jpg>
{'auction_title': '',
'c_o_2_emission_value': 174,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.9L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:29:53Z',
'fuel_type': 'diesel',
'id': 'fa167e4a-2160-5c49-9e91-173599ad1699',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB55961',
'listing': 'auction',
'location': 'FR, Seynod',
'make': 'Suzuki',
'model': 'SX4',
'odometer': 190988,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa167e4a-2160-5c49-9e91-173599ad1699/fa167e4a-2160-5c49-9e91-173599ad1699_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87630,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_2f6e178eeb6a2034a39b775964c21058.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa167e4a-2160-5c49-9e91-173599ad1699/fa167e4a-2160-5c49-9e91-173599ad1699_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_5d6289294269372f69df74eb6aa73d04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa167e4a-2160-5c49-9e91-173599ad1699/fa167e4a-2160-5c49-9e91-173599ad1699_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72058,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_881c1a824fd84e2cc68b181bb8b71c61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa167e4a-2160-5c49-9e91-173599ad1699/fa167e4a-2160-5c49-9e91-173599ad1699_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_42a36f6e6db6acd20b69bfe4ebf77343.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa167e4a-2160-5c49-9e91-173599ad1699/fa167e4a-2160-5c49-9e91-173599ad1699_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86776,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_38ff96afe6af417e7a3d5f0c73522179.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa167e4a-2160-5c49-9e91-173599ad1699/fa167e4a-2160-5c49-9e91-173599ad1699_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38142,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/33/d0333bb83bbab5f309fd993ef542cb16/pa/PB55961_6f209d0d2083a3558291cb1dee94492a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-11-27',
'seats_number': 5,
'seller_name': None,
'title': 'Suzuki SX4 1.9 DDiS GLX 4x4',
'transmission': 'manual',
'trim': 'GLX 4x4',
'year': 2006}
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB55961%27 HTTP/1.1" 200 None
2026-03-30 11:17:23 [auto1.fr] INFO: Saving data for PB55961: {'created_time': 1774869443.045572, 'last_price_update_time': 1774869443.045583, 'auction_closing_time': 1774970993.0}
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PB55961') HTTP/1.1" 204 0
2026-03-30 11:17:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738726c90>
2026-03-30 11:17:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6ab7a2-9567-53af-b30f-b7a641b95e07/8f6ab7a2-9567-53af-b30f-b7a641b95e07_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa997d96351f9b25f8e8147ad8ac5c688%252Fpa%252FFS93369_3cab43a84a0d65f881b7256f3b016090.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_3cab43a84a0d65f881b7256f3b016090.jpg saved to cache
2026-03-30 11:17:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f6ab7a2-9567-53af-b30f-b7a641b95e07
2026-03-30 11:17:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f6ab7a2-9567-53af-b30f-b7a641b95e07, skipping ID generation
2026-03-30 11:17:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f6ab7a2-9567-53af-b30f-b7a641b95e07 with scrape type 1
2026-03-30 11:17:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f6ab7a2-9567-53af-b30f-b7a641b95e07 sending to next pipeline
2026-03-30 11:17:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8f6ab7a2-9567-53af-b30f-b7a641b95e07, identifier: FS93369
2026-03-30 11:17:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8f6ab7a2-9567-53af-b30f-b7a641b95e07 with identifier: FS93369
2026-03-30 11:17:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8f6ab7a2-9567-53af-b30f-b7a641b95e07 with identifier: FS93369
2026-03-30 11:17:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8f6ab7a2-9567-53af-b30f-b7a641b95e07 with identifier: FS93369 to the API
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_3cab43a84a0d65f881b7256f3b016090.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:05:53Z',
'fuel_type': 'diesel',
'id': '8f6ab7a2-9567-53af-b30f-b7a641b95e07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS93369',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 168982,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f6ab7a2-9567-53af-b30f-b7a641b95e07/8f6ab7a2-9567-53af-b30f-b7a641b95e07_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55929,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_3cab43a84a0d65f881b7256f3b016090.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f6ab7a2-9567-53af-b30f-b7a641b95e07/8f6ab7a2-9567-53af-b30f-b7a641b95e07_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_0f58cf332abd2f002ce5fd2ea56b5c5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f6ab7a2-9567-53af-b30f-b7a641b95e07/8f6ab7a2-9567-53af-b30f-b7a641b95e07_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_6cc7530ad8f06c9e774de4f0239a2600.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f6ab7a2-9567-53af-b30f-b7a641b95e07/8f6ab7a2-9567-53af-b30f-b7a641b95e07_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37829,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_bde913f4ad05a982e3827018aacf6765.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f6ab7a2-9567-53af-b30f-b7a641b95e07/8f6ab7a2-9567-53af-b30f-b7a641b95e07_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42911,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_046b01611e7547bc0f2695e855881508.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f6ab7a2-9567-53af-b30f-b7a641b95e07/8f6ab7a2-9567-53af-b30f-b7a641b95e07_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53888,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_ef9b8a9a545c6576a4fd548965827077.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f6ab7a2-9567-53af-b30f-b7a641b95e07/8f6ab7a2-9567-53af-b30f-b7a641b95e07_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50928,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_97cb265b927a4f41e2c409619c05fc46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f6ab7a2-9567-53af-b30f-b7a641b95e07/8f6ab7a2-9567-53af-b30f-b7a641b95e07_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_be57de8b647c3dce9e9eac65e2911825.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f6ab7a2-9567-53af-b30f-b7a641b95e07/8f6ab7a2-9567-53af-b30f-b7a641b95e07_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90759,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_8dc09e3a2f46f1e77a48c59ff39cc128.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f6ab7a2-9567-53af-b30f-b7a641b95e07/8f6ab7a2-9567-53af-b30f-b7a641b95e07_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/97/a997d96351f9b25f8e8147ad8ac5c688/pa/FS93369_3914b518b3d5cd9683de4a011aa64c5c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-12-17',
'seats_number': 3,
'seller_name': None,
'title': 'Renault Kangoo 1.5 dCi Express Compact Extra',
'transmission': 'manual',
'trim': 'Express Compact Extra',
'year': 2014}
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS93369%27 HTTP/1.1" 200 None
2026-03-30 11:17:23 [auto1.fr] INFO: Saving data for FS93369: {'created_time': 1774869443.557898, 'last_price_update_time': 1774869443.557909, 'auction_closing_time': 1774969553.0}
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FS93369') HTTP/1.1" 204 0
2026-03-30 11:17:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL70342/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YX07310/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EZ54447/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ51086> (referer: https://www.auto1.com/v1/car-details-view/WJ51086/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6237e5db-aa3a-5b8a-953f-b1c583b4ebc4 with identifier: WJ51086
2026-03-30 11:17:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6237e5db-aa3a-5b8a-953f-b1c583b4ebc4 with scrape type 1
2026-03-30 11:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6237e5db-aa3a-5b8a-953f-b1c583b4ebc4
2026-03-30 11:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa1%252F8ea14c3cc85997df9ae3278e8c2c39d9%252Fpa%252FWJ51086_03648b6af30133e40ce27ab8634ac546.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_03648b6af30133e40ce27ab8634ac546.jpg not downloaded yet
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa1%252F8ea14c3cc85997df9ae3278e8c2c39d9%252Fpa%252FWJ51086_0550f96f942009f3f4df819fa9145f24.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_0550f96f942009f3f4df819fa9145f24.jpg not downloaded yet
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa1%252F8ea14c3cc85997df9ae3278e8c2c39d9%252Fpa%252FWJ51086_807d1b3da4fafb76cde96a5e253f717b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_807d1b3da4fafb76cde96a5e253f717b.jpg not downloaded yet
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa1%252F8ea14c3cc85997df9ae3278e8c2c39d9%252Fpa%252FWJ51086_a9b87545c5eb2038d9554ecc33717902.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_a9b87545c5eb2038d9554ecc33717902.jpg not downloaded yet
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa1%252F8ea14c3cc85997df9ae3278e8c2c39d9%252Fpa%252FWJ51086_d976acd114272b2adca26da5ed7a30ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_d976acd114272b2adca26da5ed7a30ad.jpg not downloaded yet
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa1%252F8ea14c3cc85997df9ae3278e8c2c39d9%252Fpa%252FWJ51086_029c9d94280e8a9303be75de16a2ebe6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_029c9d94280e8a9303be75de16a2ebe6.jpg not downloaded yet
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa1%252F8ea14c3cc85997df9ae3278e8c2c39d9%252Fpa%252FWJ51086_f2e6e3e181fa1dd9bffa67e67be7722a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_f2e6e3e181fa1dd9bffa67e67be7722a.jpg not downloaded yet
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa1%252F8ea14c3cc85997df9ae3278e8c2c39d9%252Fpa%252FWJ51086_1295ca7a9b842b0004beec4ca618cb4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_1295ca7a9b842b0004beec4ca618cb4f.jpg not downloaded yet
2026-03-30 11:17:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UV64510> (referer: https://www.auto1.com/v1/car-details-view/UV64510/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa1%252F8ea14c3cc85997df9ae3278e8c2c39d9%252Fpa%252FWJ51086_f057d8f62e2265d36eb00b09f493aa2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_f057d8f62e2265d36eb00b09f493aa2d.jpg not downloaded yet
2026-03-30 11:17:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa1%252F8ea14c3cc85997df9ae3278e8c2c39d9%252Fpa%252FWJ51086_ccb98898e84de540725fe895b141efdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_ccb98898e84de540725fe895b141efdc.jpg not downloaded yet
2026-03-30 11:17:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a2717b5-49bb-54a3-ab56-1f8ebd076011 with identifier: UV64510
2026-03-30 11:17:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a2717b5-49bb-54a3-ab56-1f8ebd076011 with scrape type 1
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a2717b5-49bb-54a3-ab56-1f8ebd076011
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F0a%252F300a368377f7ccce6b47568fb8239001%252Fpa%252FUV64510_415e50cd90a711b1b0c0a3bf4c5eb65b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_415e50cd90a711b1b0c0a3bf4c5eb65b.jpg already downloaded
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F0a%252F300a368377f7ccce6b47568fb8239001%252Fpa%252FUV64510_0f3ce3bab924e9f889a1c9116ecce08b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_0f3ce3bab924e9f889a1c9116ecce08b.jpg already downloaded
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F0a%252F300a368377f7ccce6b47568fb8239001%252Fpa%252FUV64510_b3edf0245e2b16cd95ad26ec8d3f5954.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_b3edf0245e2b16cd95ad26ec8d3f5954.jpg already downloaded
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F0a%252F300a368377f7ccce6b47568fb8239001%252Fpa%252FUV64510_3b496af918b8632bc20ef173eb8a4819.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_3b496af918b8632bc20ef173eb8a4819.jpg already downloaded
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F0a%252F300a368377f7ccce6b47568fb8239001%252Fpa%252FUV64510_e2efd725379d71dacf318933889c3f90.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_e2efd725379d71dacf318933889c3f90.jpg already downloaded
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F0a%252F300a368377f7ccce6b47568fb8239001%252Fpa%252FUV64510_9c7ed48aae78d4054b6a92107a9ddfe8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_9c7ed48aae78d4054b6a92107a9ddfe8.jpg already downloaded
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F0a%252F300a368377f7ccce6b47568fb8239001%252Fpa%252FUV64510_ae293fab4beb34785085db12e7b67808.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_ae293fab4beb34785085db12e7b67808.jpg already downloaded
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F0a%252F300a368377f7ccce6b47568fb8239001%252Fpa%252FUV64510_10cceb485cf090b4e158ef1fd5d17f15.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_10cceb485cf090b4e158ef1fd5d17f15.jpg already downloaded
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F0a%252F300a368377f7ccce6b47568fb8239001%252Fpa%252FUV64510_9a8044db8465e3c2e22983d84441bb54.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_9a8044db8465e3c2e22983d84441bb54.jpg already downloaded
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F0a%252F300a368377f7ccce6b47568fb8239001%252Fpa%252FUV64510_dfc6b08a97d2349034faf806f0266827.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_dfc6b08a97d2349034faf806f0266827.jpg already downloaded
2026-03-30 11:17:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9a2717b5-49bb-54a3-ab56-1f8ebd076011, identifier: UV64510
2026-03-30 11:17:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9a2717b5-49bb-54a3-ab56-1f8ebd076011 with identifier: UV64510
2026-03-30 11:17:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9a2717b5-49bb-54a3-ab56-1f8ebd076011 with identifier: UV64510
2026-03-30 11:17:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9a2717b5-49bb-54a3-ab56-1f8ebd076011 with identifier: UV64510 to the API
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UV64510>
{'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:59:29Z',
'fuel_type': 'diesel',
'id': '9a2717b5-49bb-54a3-ab56-1f8ebd076011',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV64510',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 151521,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_415e50cd90a711b1b0c0a3bf4c5eb65b.jpg',
'https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_0f3ce3bab924e9f889a1c9116ecce08b.jpg',
'https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_b3edf0245e2b16cd95ad26ec8d3f5954.jpg',
'https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_3b496af918b8632bc20ef173eb8a4819.jpg',
'https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_e2efd725379d71dacf318933889c3f90.jpg',
'https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_9c7ed48aae78d4054b6a92107a9ddfe8.jpg',
'https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_ae293fab4beb34785085db12e7b67808.jpg',
'https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_10cceb485cf090b4e158ef1fd5d17f15.jpg',
'https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_9a8044db8465e3c2e22983d84441bb54.jpg',
'https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_dfc6b08a97d2349034faf806f0266827.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2717b5-49bb-54a3-ab56-1f8ebd076011/9a2717b5-49bb-54a3-ab56-1f8ebd076011_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82207,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_415e50cd90a711b1b0c0a3bf4c5eb65b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2717b5-49bb-54a3-ab56-1f8ebd076011/9a2717b5-49bb-54a3-ab56-1f8ebd076011_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81507,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_0f3ce3bab924e9f889a1c9116ecce08b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2717b5-49bb-54a3-ab56-1f8ebd076011/9a2717b5-49bb-54a3-ab56-1f8ebd076011_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77929,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_b3edf0245e2b16cd95ad26ec8d3f5954.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2717b5-49bb-54a3-ab56-1f8ebd076011/9a2717b5-49bb-54a3-ab56-1f8ebd076011_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2698036,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_3b496af918b8632bc20ef173eb8a4819.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2717b5-49bb-54a3-ab56-1f8ebd076011/9a2717b5-49bb-54a3-ab56-1f8ebd076011_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_e2efd725379d71dacf318933889c3f90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2717b5-49bb-54a3-ab56-1f8ebd076011/9a2717b5-49bb-54a3-ab56-1f8ebd076011_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78445,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_9c7ed48aae78d4054b6a92107a9ddfe8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2717b5-49bb-54a3-ab56-1f8ebd076011/9a2717b5-49bb-54a3-ab56-1f8ebd076011_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2647012,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_ae293fab4beb34785085db12e7b67808.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2717b5-49bb-54a3-ab56-1f8ebd076011/9a2717b5-49bb-54a3-ab56-1f8ebd076011_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79261,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_10cceb485cf090b4e158ef1fd5d17f15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2717b5-49bb-54a3-ab56-1f8ebd076011/9a2717b5-49bb-54a3-ab56-1f8ebd076011_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_9a8044db8465e3c2e22983d84441bb54.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2717b5-49bb-54a3-ab56-1f8ebd076011/9a2717b5-49bb-54a3-ab56-1f8ebd076011_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2625312,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img30/0a/300a368377f7ccce6b47568fb8239001/pa/UV64510_dfc6b08a97d2349034faf806f0266827.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-11-17',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 180 d Sensation',
'transmission': 'automatic',
'trim': 'Sensation',
'year': 2015}
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV64510%27 HTTP/1.1" 200 None
2026-03-30 11:17:39 [auto1.fr] INFO: Saving data for UV64510: {'created_time': 1774869459.857006, 'last_price_update_time': 1774869459.857018, 'auction_closing_time': 1774972769.0}
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UV64510') HTTP/1.1" 204 0
2026-03-30 11:17:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_1295ca7a9b842b0004beec4ca618cb4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH19496/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_ccb98898e84de540725fe895b141efdc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383c0dd0>
2026-03-30 11:17:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6237e5db-aa3a-5b8a-953f-b1c583b4ebc4/6237e5db-aa3a-5b8a-953f-b1c583b4ebc4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa1%252F8ea14c3cc85997df9ae3278e8c2c39d9%252Fpa%252FWJ51086_1295ca7a9b842b0004beec4ca618cb4f.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_1295ca7a9b842b0004beec4ca618cb4f.jpg saved to cache
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6237e5db-aa3a-5b8a-953f-b1c583b4ebc4
2026-03-30 11:17:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_f2e6e3e181fa1dd9bffa67e67be7722a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738684210>
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6237e5db-aa3a-5b8a-953f-b1c583b4ebc4/6237e5db-aa3a-5b8a-953f-b1c583b4ebc4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa1%252F8ea14c3cc85997df9ae3278e8c2c39d9%252Fpa%252FWJ51086_ccb98898e84de540725fe895b141efdc.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_ccb98898e84de540725fe895b141efdc.jpg saved to cache
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6237e5db-aa3a-5b8a-953f-b1c583b4ebc4
2026-03-30 11:17:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_f057d8f62e2265d36eb00b09f493aa2d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073871ce50>
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6237e5db-aa3a-5b8a-953f-b1c583b4ebc4/6237e5db-aa3a-5b8a-953f-b1c583b4ebc4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa1%252F8ea14c3cc85997df9ae3278e8c2c39d9%252Fpa%252FWJ51086_f2e6e3e181fa1dd9bffa67e67be7722a.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_f2e6e3e181fa1dd9bffa67e67be7722a.jpg saved to cache
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6237e5db-aa3a-5b8a-953f-b1c583b4ebc4
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385eba90>
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6237e5db-aa3a-5b8a-953f-b1c583b4ebc4/6237e5db-aa3a-5b8a-953f-b1c583b4ebc4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa1%252F8ea14c3cc85997df9ae3278e8c2c39d9%252Fpa%252FWJ51086_f057d8f62e2265d36eb00b09f493aa2d.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_f057d8f62e2265d36eb00b09f493aa2d.jpg saved to cache
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6237e5db-aa3a-5b8a-953f-b1c583b4ebc4
2026-03-30 11:17:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_029c9d94280e8a9303be75de16a2ebe6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385a8e10>
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6237e5db-aa3a-5b8a-953f-b1c583b4ebc4/6237e5db-aa3a-5b8a-953f-b1c583b4ebc4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa1%252F8ea14c3cc85997df9ae3278e8c2c39d9%252Fpa%252FWJ51086_029c9d94280e8a9303be75de16a2ebe6.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_029c9d94280e8a9303be75de16a2ebe6.jpg saved to cache
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6237e5db-aa3a-5b8a-953f-b1c583b4ebc4
2026-03-30 11:17:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_d976acd114272b2adca26da5ed7a30ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_a9b87545c5eb2038d9554ecc33717902.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_807d1b3da4fafb76cde96a5e253f717b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738716b10>
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6237e5db-aa3a-5b8a-953f-b1c583b4ebc4/6237e5db-aa3a-5b8a-953f-b1c583b4ebc4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa1%252F8ea14c3cc85997df9ae3278e8c2c39d9%252Fpa%252FWJ51086_d976acd114272b2adca26da5ed7a30ad.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_d976acd114272b2adca26da5ed7a30ad.jpg saved to cache
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6237e5db-aa3a-5b8a-953f-b1c583b4ebc4
2026-03-30 11:17:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_0550f96f942009f3f4df819fa9145f24.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738561850>
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6237e5db-aa3a-5b8a-953f-b1c583b4ebc4/6237e5db-aa3a-5b8a-953f-b1c583b4ebc4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa1%252F8ea14c3cc85997df9ae3278e8c2c39d9%252Fpa%252FWJ51086_a9b87545c5eb2038d9554ecc33717902.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_a9b87545c5eb2038d9554ecc33717902.jpg saved to cache
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6237e5db-aa3a-5b8a-953f-b1c583b4ebc4
2026-03-30 11:17:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_03648b6af30133e40ce27ab8634ac546.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738783750>
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6237e5db-aa3a-5b8a-953f-b1c583b4ebc4/6237e5db-aa3a-5b8a-953f-b1c583b4ebc4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa1%252F8ea14c3cc85997df9ae3278e8c2c39d9%252Fpa%252FWJ51086_807d1b3da4fafb76cde96a5e253f717b.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_807d1b3da4fafb76cde96a5e253f717b.jpg saved to cache
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6237e5db-aa3a-5b8a-953f-b1c583b4ebc4
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384b2b50>
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6237e5db-aa3a-5b8a-953f-b1c583b4ebc4/6237e5db-aa3a-5b8a-953f-b1c583b4ebc4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa1%252F8ea14c3cc85997df9ae3278e8c2c39d9%252Fpa%252FWJ51086_0550f96f942009f3f4df819fa9145f24.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_0550f96f942009f3f4df819fa9145f24.jpg saved to cache
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6237e5db-aa3a-5b8a-953f-b1c583b4ebc4
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738531e90>
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6237e5db-aa3a-5b8a-953f-b1c583b4ebc4/6237e5db-aa3a-5b8a-953f-b1c583b4ebc4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa1%252F8ea14c3cc85997df9ae3278e8c2c39d9%252Fpa%252FWJ51086_03648b6af30133e40ce27ab8634ac546.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_03648b6af30133e40ce27ab8634ac546.jpg saved to cache
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6237e5db-aa3a-5b8a-953f-b1c583b4ebc4
2026-03-30 11:17:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6237e5db-aa3a-5b8a-953f-b1c583b4ebc4, skipping ID generation
2026-03-30 11:17:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6237e5db-aa3a-5b8a-953f-b1c583b4ebc4 with scrape type 1
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6237e5db-aa3a-5b8a-953f-b1c583b4ebc4 sending to next pipeline
2026-03-30 11:17:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6237e5db-aa3a-5b8a-953f-b1c583b4ebc4, identifier: WJ51086
2026-03-30 11:17:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6237e5db-aa3a-5b8a-953f-b1c583b4ebc4 with identifier: WJ51086
2026-03-30 11:17:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6237e5db-aa3a-5b8a-953f-b1c583b4ebc4 with identifier: WJ51086
2026-03-30 11:17:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6237e5db-aa3a-5b8a-953f-b1c583b4ebc4 with identifier: WJ51086 to the API
2026-03-30 11:17:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_03648b6af30133e40ce27ab8634ac546.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 179,
'expiration_date': '2026-03-31T15:52:15Z',
'fuel_type': 'diesel',
'id': '6237e5db-aa3a-5b8a-953f-b1c583b4ebc4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ51086',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Citroen',
'model': 'C5 Aircross',
'odometer': 150627,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6237e5db-aa3a-5b8a-953f-b1c583b4ebc4/6237e5db-aa3a-5b8a-953f-b1c583b4ebc4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_03648b6af30133e40ce27ab8634ac546.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6237e5db-aa3a-5b8a-953f-b1c583b4ebc4/6237e5db-aa3a-5b8a-953f-b1c583b4ebc4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85466,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_0550f96f942009f3f4df819fa9145f24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6237e5db-aa3a-5b8a-953f-b1c583b4ebc4/6237e5db-aa3a-5b8a-953f-b1c583b4ebc4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100898,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_807d1b3da4fafb76cde96a5e253f717b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6237e5db-aa3a-5b8a-953f-b1c583b4ebc4/6237e5db-aa3a-5b8a-953f-b1c583b4ebc4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_a9b87545c5eb2038d9554ecc33717902.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6237e5db-aa3a-5b8a-953f-b1c583b4ebc4/6237e5db-aa3a-5b8a-953f-b1c583b4ebc4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97714,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_d976acd114272b2adca26da5ed7a30ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6237e5db-aa3a-5b8a-953f-b1c583b4ebc4/6237e5db-aa3a-5b8a-953f-b1c583b4ebc4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112930,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_029c9d94280e8a9303be75de16a2ebe6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6237e5db-aa3a-5b8a-953f-b1c583b4ebc4/6237e5db-aa3a-5b8a-953f-b1c583b4ebc4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111496,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_f2e6e3e181fa1dd9bffa67e67be7722a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6237e5db-aa3a-5b8a-953f-b1c583b4ebc4/6237e5db-aa3a-5b8a-953f-b1c583b4ebc4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_1295ca7a9b842b0004beec4ca618cb4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6237e5db-aa3a-5b8a-953f-b1c583b4ebc4/6237e5db-aa3a-5b8a-953f-b1c583b4ebc4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83570,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_f057d8f62e2265d36eb00b09f493aa2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6237e5db-aa3a-5b8a-953f-b1c583b4ebc4/6237e5db-aa3a-5b8a-953f-b1c583b4ebc4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91034,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a1/8ea14c3cc85997df9ae3278e8c2c39d9/pa/WJ51086_ccb98898e84de540725fe895b141efdc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-08',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C5 Aircross 2.0 Blue-HDi Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2019}
2026-03-30 11:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ51086%27 HTTP/1.1" 200 None
2026-03-30 11:17:41 [auto1.fr] INFO: Saving data for WJ51086: {'created_time': 1774869461.371927, 'last_price_update_time': 1774869461.371983, 'auction_closing_time': 1774972335.0}
2026-03-30 11:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WJ51086') HTTP/1.1" 204 0
2026-03-30 11:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH85075> (referer: https://www.auto1.com/v1/car-details-view/PH85075/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fec8df8d-1846-5f63-b554-f07da3dc6422 with identifier: PH85075
2026-03-30 11:17:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fec8df8d-1846-5f63-b554-f07da3dc6422 with scrape type 1
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fec8df8d-1846-5f63-b554-f07da3dc6422
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F23%252Fa923d9d5598b52d5b14011c447022b16%252Fpa%252FPH85075_1e115d9acc85ceee5f23bb4e3850a4a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_1e115d9acc85ceee5f23bb4e3850a4a7.jpg not downloaded yet
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F23%252Fa923d9d5598b52d5b14011c447022b16%252Fpa%252FPH85075_7e6b3e76016cc571cdfdf8b03566ec19.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_7e6b3e76016cc571cdfdf8b03566ec19.jpg not downloaded yet
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F23%252Fa923d9d5598b52d5b14011c447022b16%252Fpa%252FPH85075_361e780057a465da5972832edb566f4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_361e780057a465da5972832edb566f4d.jpg not downloaded yet
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F23%252Fa923d9d5598b52d5b14011c447022b16%252Fpa%252FPH85075_ae8873bc7701002e7ae3fe9676224326.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_ae8873bc7701002e7ae3fe9676224326.jpg not downloaded yet
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F23%252Fa923d9d5598b52d5b14011c447022b16%252Fpa%252FPH85075_6d2f06c0dad37f6916dd665fccee01ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_6d2f06c0dad37f6916dd665fccee01ba.jpg not downloaded yet
2026-03-30 11:17:42 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.454(s), this was the 1st time calling it.
2026-03-30 11:17:42 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.988565361435673 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F23%252Fa923d9d5598b52d5b14011c447022b16%252Fpa%252FPH85075_7630f34b1959bf258ff643f3a8cc9e25.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_7630f34b1959bf258ff643f3a8cc9e25.jpg not downloaded yet
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F23%252Fa923d9d5598b52d5b14011c447022b16%252Fpa%252FPH85075_f37e88cf67d4d8fe0d647aed6a24d841.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_f37e88cf67d4d8fe0d647aed6a24d841.jpg not downloaded yet
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F23%252Fa923d9d5598b52d5b14011c447022b16%252Fpa%252FPH85075_97c8ebb59c5e4c5f39f38e4ae75c30c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_97c8ebb59c5e4c5f39f38e4ae75c30c3.jpg not downloaded yet
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F23%252Fa923d9d5598b52d5b14011c447022b16%252Fpa%252FPH85075_3eba163090e26459ca8696be050c73bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_3eba163090e26459ca8696be050c73bd.jpg not downloaded yet
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F23%252Fa923d9d5598b52d5b14011c447022b16%252Fpa%252FPH85075_98d7b498c666b12869636c0517b828ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_98d7b498c666b12869636c0517b828ee.jpg not downloaded yet
2026-03-30 11:17:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UH12185> (referer: https://www.auto1.com/v1/car-details-view/UH12185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8413128a-ddad-53c6-b277-c2075ffaa862 with identifier: UH12185
2026-03-30 11:17:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8413128a-ddad-53c6-b277-c2075ffaa862 with scrape type 1
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8413128a-ddad-53c6-b277-c2075ffaa862
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F3e%252F3b3e7236bd977dc6e5821575dc386e3b%252Fpa%252FUH12185_173d14d1b80839735966ba0475918747.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_173d14d1b80839735966ba0475918747.jpg already downloaded
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F3e%252F3b3e7236bd977dc6e5821575dc386e3b%252Fpa%252FUH12185_3c5dea21657edcd5a664e622bade29d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_3c5dea21657edcd5a664e622bade29d7.jpg already downloaded
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F3e%252F3b3e7236bd977dc6e5821575dc386e3b%252Fpa%252FUH12185_6c8901985c61362bd270eababa639789.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_6c8901985c61362bd270eababa639789.jpg already downloaded
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F3e%252F3b3e7236bd977dc6e5821575dc386e3b%252Fpa%252FUH12185_f0f59c15930fcf1f85b64bb73a9c987d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_f0f59c15930fcf1f85b64bb73a9c987d.jpg already downloaded
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F3e%252F3b3e7236bd977dc6e5821575dc386e3b%252Fpa%252FUH12185_5debead2f0569bf379c6c5bd2a5d3959.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_5debead2f0569bf379c6c5bd2a5d3959.jpg already downloaded
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F3e%252F3b3e7236bd977dc6e5821575dc386e3b%252Fpa%252FUH12185_8697e3edd8a43ff36d95896d8c74c92f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_8697e3edd8a43ff36d95896d8c74c92f.jpg already downloaded
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F3e%252F3b3e7236bd977dc6e5821575dc386e3b%252Fpa%252FUH12185_c5e02d7da2facc1bbfa3afc337f81626.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_c5e02d7da2facc1bbfa3afc337f81626.jpg already downloaded
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F3e%252F3b3e7236bd977dc6e5821575dc386e3b%252Fpa%252FUH12185_e18bac2e5311bf635cf64fb145d4b004.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_e18bac2e5311bf635cf64fb145d4b004.jpg already downloaded
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F3e%252F3b3e7236bd977dc6e5821575dc386e3b%252Fpa%252FUH12185_91cedc7e12fe9c7cef633b018e6542dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_91cedc7e12fe9c7cef633b018e6542dc.jpg already downloaded
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F3e%252F3b3e7236bd977dc6e5821575dc386e3b%252Fpa%252FUH12185_e984ba6bcc662eefa11b1541671a2fc6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_e984ba6bcc662eefa11b1541671a2fc6.jpg already downloaded
2026-03-30 11:17:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8413128a-ddad-53c6-b277-c2075ffaa862, identifier: UH12185
2026-03-30 11:17:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8413128a-ddad-53c6-b277-c2075ffaa862 with identifier: UH12185
2026-03-30 11:17:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8413128a-ddad-53c6-b277-c2075ffaa862 with identifier: UH12185
2026-03-30 11:17:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8413128a-ddad-53c6-b277-c2075ffaa862 with identifier: UH12185 to the API
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UH12185>
{'auction_title': '',
'c_o_2_emission_value': 86,
'category': 'Taxi',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.8L',
'engine_horse_power': 122,
'expiration_date': '2026-03-31T15:40:16Z',
'fuel_type': 'hybrid',
'id': '8413128a-ddad-53c6-b277-c2075ffaa862',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH12185',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Toyota',
'model': 'C-HR',
'odometer': 147131,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_173d14d1b80839735966ba0475918747.jpg',
'https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_3c5dea21657edcd5a664e622bade29d7.jpg',
'https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_6c8901985c61362bd270eababa639789.jpg',
'https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_f0f59c15930fcf1f85b64bb73a9c987d.jpg',
'https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_5debead2f0569bf379c6c5bd2a5d3959.jpg',
'https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_8697e3edd8a43ff36d95896d8c74c92f.jpg',
'https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_c5e02d7da2facc1bbfa3afc337f81626.jpg',
'https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_e18bac2e5311bf635cf64fb145d4b004.jpg',
'https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_91cedc7e12fe9c7cef633b018e6542dc.jpg',
'https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_e984ba6bcc662eefa11b1541671a2fc6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413128a-ddad-53c6-b277-c2075ffaa862/8413128a-ddad-53c6-b277-c2075ffaa862_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_173d14d1b80839735966ba0475918747.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413128a-ddad-53c6-b277-c2075ffaa862/8413128a-ddad-53c6-b277-c2075ffaa862_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3254876,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_3c5dea21657edcd5a664e622bade29d7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413128a-ddad-53c6-b277-c2075ffaa862/8413128a-ddad-53c6-b277-c2075ffaa862_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73618,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_6c8901985c61362bd270eababa639789.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413128a-ddad-53c6-b277-c2075ffaa862/8413128a-ddad-53c6-b277-c2075ffaa862_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65142,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_f0f59c15930fcf1f85b64bb73a9c987d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413128a-ddad-53c6-b277-c2075ffaa862/8413128a-ddad-53c6-b277-c2075ffaa862_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79388,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_5debead2f0569bf379c6c5bd2a5d3959.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413128a-ddad-53c6-b277-c2075ffaa862/8413128a-ddad-53c6-b277-c2075ffaa862_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_8697e3edd8a43ff36d95896d8c74c92f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413128a-ddad-53c6-b277-c2075ffaa862/8413128a-ddad-53c6-b277-c2075ffaa862_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2925151,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_c5e02d7da2facc1bbfa3afc337f81626.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413128a-ddad-53c6-b277-c2075ffaa862/8413128a-ddad-53c6-b277-c2075ffaa862_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73480,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_e18bac2e5311bf635cf64fb145d4b004.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413128a-ddad-53c6-b277-c2075ffaa862/8413128a-ddad-53c6-b277-c2075ffaa862_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62941,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_91cedc7e12fe9c7cef633b018e6542dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8413128a-ddad-53c6-b277-c2075ffaa862/8413128a-ddad-53c6-b277-c2075ffaa862_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61320,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/3e/3b3e7236bd977dc6e5821575dc386e3b/pa/UH12185_e984ba6bcc662eefa11b1541671a2fc6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-06',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota C-HR 1.8 Hybrid Graphic',
'transmission': 'automatic',
'trim': 'Graphic',
'year': 2019}
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UH12185%27 HTTP/1.1" 200 None
2026-03-30 11:17:44 [auto1.fr] INFO: Saving data for UH12185: {'created_time': 1774869464.190885, 'last_price_update_time': 1774869464.190896, 'auction_closing_time': 1774971616.0}
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UH12185') HTTP/1.1" 204 0
2026-03-30 11:17:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_98d7b498c666b12869636c0517b828ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_3eba163090e26459ca8696be050c73bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383b1ed0>
2026-03-30 11:17:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fec8df8d-1846-5f63-b554-f07da3dc6422/fec8df8d-1846-5f63-b554-f07da3dc6422_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F23%252Fa923d9d5598b52d5b14011c447022b16%252Fpa%252FPH85075_98d7b498c666b12869636c0517b828ee.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_98d7b498c666b12869636c0517b828ee.jpg saved to cache
2026-03-30 11:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fec8df8d-1846-5f63-b554-f07da3dc6422
2026-03-30 11:17:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a534190>
2026-03-30 11:17:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fec8df8d-1846-5f63-b554-f07da3dc6422/fec8df8d-1846-5f63-b554-f07da3dc6422_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F23%252Fa923d9d5598b52d5b14011c447022b16%252Fpa%252FPH85075_3eba163090e26459ca8696be050c73bd.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_3eba163090e26459ca8696be050c73bd.jpg saved to cache
2026-03-30 11:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fec8df8d-1846-5f63-b554-f07da3dc6422
2026-03-30 11:17:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_97c8ebb59c5e4c5f39f38e4ae75c30c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738533e90>
2026-03-30 11:17:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fec8df8d-1846-5f63-b554-f07da3dc6422/fec8df8d-1846-5f63-b554-f07da3dc6422_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F23%252Fa923d9d5598b52d5b14011c447022b16%252Fpa%252FPH85075_97c8ebb59c5e4c5f39f38e4ae75c30c3.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_97c8ebb59c5e4c5f39f38e4ae75c30c3.jpg saved to cache
2026-03-30 11:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fec8df8d-1846-5f63-b554-f07da3dc6422
2026-03-30 11:17:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_f37e88cf67d4d8fe0d647aed6a24d841.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07387253d0>
2026-03-30 11:17:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fec8df8d-1846-5f63-b554-f07da3dc6422/fec8df8d-1846-5f63-b554-f07da3dc6422_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F23%252Fa923d9d5598b52d5b14011c447022b16%252Fpa%252FPH85075_f37e88cf67d4d8fe0d647aed6a24d841.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_f37e88cf67d4d8fe0d647aed6a24d841.jpg saved to cache
2026-03-30 11:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fec8df8d-1846-5f63-b554-f07da3dc6422
2026-03-30 11:17:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_7630f34b1959bf258ff643f3a8cc9e25.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WD02529/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385bc590>
2026-03-30 11:17:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fec8df8d-1846-5f63-b554-f07da3dc6422/fec8df8d-1846-5f63-b554-f07da3dc6422_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F23%252Fa923d9d5598b52d5b14011c447022b16%252Fpa%252FPH85075_7630f34b1959bf258ff643f3a8cc9e25.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_7630f34b1959bf258ff643f3a8cc9e25.jpg saved to cache
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fec8df8d-1846-5f63-b554-f07da3dc6422
2026-03-30 11:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_ae8873bc7701002e7ae3fe9676224326.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_6d2f06c0dad37f6916dd665fccee01ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_361e780057a465da5972832edb566f4d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_1e115d9acc85ceee5f23bb4e3850a4a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073878bd10>
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fec8df8d-1846-5f63-b554-f07da3dc6422/fec8df8d-1846-5f63-b554-f07da3dc6422_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F23%252Fa923d9d5598b52d5b14011c447022b16%252Fpa%252FPH85075_ae8873bc7701002e7ae3fe9676224326.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_ae8873bc7701002e7ae3fe9676224326.jpg saved to cache
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fec8df8d-1846-5f63-b554-f07da3dc6422
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738725450>
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fec8df8d-1846-5f63-b554-f07da3dc6422/fec8df8d-1846-5f63-b554-f07da3dc6422_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F23%252Fa923d9d5598b52d5b14011c447022b16%252Fpa%252FPH85075_6d2f06c0dad37f6916dd665fccee01ba.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_6d2f06c0dad37f6916dd665fccee01ba.jpg saved to cache
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fec8df8d-1846-5f63-b554-f07da3dc6422
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385d6350>
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fec8df8d-1846-5f63-b554-f07da3dc6422/fec8df8d-1846-5f63-b554-f07da3dc6422_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F23%252Fa923d9d5598b52d5b14011c447022b16%252Fpa%252FPH85075_361e780057a465da5972832edb566f4d.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_361e780057a465da5972832edb566f4d.jpg saved to cache
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fec8df8d-1846-5f63-b554-f07da3dc6422
2026-03-30 11:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_7e6b3e76016cc571cdfdf8b03566ec19.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ86489> (referer: https://www.auto1.com/v1/car-details-view/TZ86489/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738597710>
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fec8df8d-1846-5f63-b554-f07da3dc6422/fec8df8d-1846-5f63-b554-f07da3dc6422_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F23%252Fa923d9d5598b52d5b14011c447022b16%252Fpa%252FPH85075_1e115d9acc85ceee5f23bb4e3850a4a7.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_1e115d9acc85ceee5f23bb4e3850a4a7.jpg saved to cache
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fec8df8d-1846-5f63-b554-f07da3dc6422
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383c3610>
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fec8df8d-1846-5f63-b554-f07da3dc6422/fec8df8d-1846-5f63-b554-f07da3dc6422_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F23%252Fa923d9d5598b52d5b14011c447022b16%252Fpa%252FPH85075_7e6b3e76016cc571cdfdf8b03566ec19.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_7e6b3e76016cc571cdfdf8b03566ec19.jpg saved to cache
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fec8df8d-1846-5f63-b554-f07da3dc6422
2026-03-30 11:17:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fec8df8d-1846-5f63-b554-f07da3dc6422, skipping ID generation
2026-03-30 11:17:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fec8df8d-1846-5f63-b554-f07da3dc6422 with scrape type 1
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fec8df8d-1846-5f63-b554-f07da3dc6422 sending to next pipeline
2026-03-30 11:17:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fec8df8d-1846-5f63-b554-f07da3dc6422, identifier: PH85075
2026-03-30 11:17:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fec8df8d-1846-5f63-b554-f07da3dc6422 with identifier: PH85075
2026-03-30 11:17:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fec8df8d-1846-5f63-b554-f07da3dc6422 with identifier: PH85075
2026-03-30 11:17:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fec8df8d-1846-5f63-b554-f07da3dc6422 with identifier: PH85075 to the API
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_7e6b3e76016cc571cdfdf8b03566ec19.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:08:30Z',
'fuel_type': 'diesel',
'id': 'fec8df8d-1846-5f63-b554-f07da3dc6422',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH85075',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 185120,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fec8df8d-1846-5f63-b554-f07da3dc6422/fec8df8d-1846-5f63-b554-f07da3dc6422_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44896,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_1e115d9acc85ceee5f23bb4e3850a4a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fec8df8d-1846-5f63-b554-f07da3dc6422/fec8df8d-1846-5f63-b554-f07da3dc6422_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_7e6b3e76016cc571cdfdf8b03566ec19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fec8df8d-1846-5f63-b554-f07da3dc6422/fec8df8d-1846-5f63-b554-f07da3dc6422_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81307,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_361e780057a465da5972832edb566f4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fec8df8d-1846-5f63-b554-f07da3dc6422/fec8df8d-1846-5f63-b554-f07da3dc6422_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37412,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_ae8873bc7701002e7ae3fe9676224326.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fec8df8d-1846-5f63-b554-f07da3dc6422/fec8df8d-1846-5f63-b554-f07da3dc6422_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45493,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_6d2f06c0dad37f6916dd665fccee01ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fec8df8d-1846-5f63-b554-f07da3dc6422/fec8df8d-1846-5f63-b554-f07da3dc6422_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_7630f34b1959bf258ff643f3a8cc9e25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fec8df8d-1846-5f63-b554-f07da3dc6422/fec8df8d-1846-5f63-b554-f07da3dc6422_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_f37e88cf67d4d8fe0d647aed6a24d841.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fec8df8d-1846-5f63-b554-f07da3dc6422/fec8df8d-1846-5f63-b554-f07da3dc6422_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_97c8ebb59c5e4c5f39f38e4ae75c30c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fec8df8d-1846-5f63-b554-f07da3dc6422/fec8df8d-1846-5f63-b554-f07da3dc6422_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_3eba163090e26459ca8696be050c73bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fec8df8d-1846-5f63-b554-f07da3dc6422/fec8df8d-1846-5f63-b554-f07da3dc6422_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66945,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/23/a923d9d5598b52d5b14011c447022b16/pa/PH85075_98d7b498c666b12869636c0517b828ee.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-06-14',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Kangoo 1.5 dCi Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2012}
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH85075%27 HTTP/1.1" 200 None
2026-03-30 11:17:46 [auto1.fr] INFO: Saving data for PH85075: {'created_time': 1774869466.114525, 'last_price_update_time': 1774869466.114537, 'auction_closing_time': 1774969710.0}
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PH85075') HTTP/1.1" 204 0
2026-03-30 11:17:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_55964e70935b56239301d2c661e69bd9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_60536e929d9ca408e7015852876361ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64c3ab2a-279b-5692-ab68-e6db4c872a7b with identifier: TZ86489
2026-03-30 11:17:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64c3ab2a-279b-5692-ab68-e6db4c872a7b with scrape type 1
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 64c3ab2a-279b-5692-ab68-e6db4c872a7b
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c13718764c31d650bd79d11d131fad%252Fpa%252FTZ86489_b9e54a4c80a57c4385ebc17853ed2e7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_b9e54a4c80a57c4385ebc17853ed2e7c.jpg not downloaded yet
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c13718764c31d650bd79d11d131fad%252Fpa%252FTZ86489_b1d8e134afd322c437638c9b72284bb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_b1d8e134afd322c437638c9b72284bb1.jpg not downloaded yet
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738429850>
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f71c55c9-2aa8-56a8-a2ad-edfe73063e08/f71c55c9-2aa8-56a8-a2ad-edfe73063e08_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46794df1a0dbad0f47a5eaf1223b5bbc%252Fpa%252FWA74710_55964e70935b56239301d2c661e69bd9.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_55964e70935b56239301d2c661e69bd9.jpg saved to cache
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f71c55c9-2aa8-56a8-a2ad-edfe73063e08
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738538490>
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f71c55c9-2aa8-56a8-a2ad-edfe73063e08/f71c55c9-2aa8-56a8-a2ad-edfe73063e08_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46794df1a0dbad0f47a5eaf1223b5bbc%252Fpa%252FWA74710_60536e929d9ca408e7015852876361ea.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_60536e929d9ca408e7015852876361ea.jpg saved to cache
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f71c55c9-2aa8-56a8-a2ad-edfe73063e08
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c13718764c31d650bd79d11d131fad%252Fpa%252FTZ86489_c23b5bc51e9820cbfff4fab1be0918cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_c23b5bc51e9820cbfff4fab1be0918cd.jpg not downloaded yet
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c13718764c31d650bd79d11d131fad%252Fpa%252FTZ86489_8227ce289debf7ac2bc64ebdb119dbd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_8227ce289debf7ac2bc64ebdb119dbd3.jpg not downloaded yet
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c13718764c31d650bd79d11d131fad%252Fpa%252FTZ86489_598749f1fd1cce9a6e101fe6f4302831.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_598749f1fd1cce9a6e101fe6f4302831.jpg not downloaded yet
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c13718764c31d650bd79d11d131fad%252Fpa%252FTZ86489_cd0d2e3c5eaefe639bf5df5c997de7cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_cd0d2e3c5eaefe639bf5df5c997de7cb.jpg not downloaded yet
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c13718764c31d650bd79d11d131fad%252Fpa%252FTZ86489_6796dc71583b887851246fc7648def35.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_6796dc71583b887851246fc7648def35.jpg not downloaded yet
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c13718764c31d650bd79d11d131fad%252Fpa%252FTZ86489_f336230cb38b8fe9d957400876dea6c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_f336230cb38b8fe9d957400876dea6c2.jpg not downloaded yet
2026-03-30 11:17:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_1247c79fdf0f2507488f0470adac0d53.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_96f8915ea443461c46aadf84b79f4637.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c13718764c31d650bd79d11d131fad%252Fpa%252FTZ86489_b6f55f73064c7d6d498bcb333618560d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_b6f55f73064c7d6d498bcb333618560d.jpg not downloaded yet
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c13718764c31d650bd79d11d131fad%252Fpa%252FTZ86489_e532bdd12fa006b1ff0bfee292acd674.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_e532bdd12fa006b1ff0bfee292acd674.jpg not downloaded yet
2026-03-30 11:17:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_6796dc71583b887851246fc7648def35.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738780d50>
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f71c55c9-2aa8-56a8-a2ad-edfe73063e08/f71c55c9-2aa8-56a8-a2ad-edfe73063e08_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46794df1a0dbad0f47a5eaf1223b5bbc%252Fpa%252FWA74710_1247c79fdf0f2507488f0470adac0d53.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_1247c79fdf0f2507488f0470adac0d53.jpg saved to cache
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f71c55c9-2aa8-56a8-a2ad-edfe73063e08
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0739413210>
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f71c55c9-2aa8-56a8-a2ad-edfe73063e08/f71c55c9-2aa8-56a8-a2ad-edfe73063e08_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46794df1a0dbad0f47a5eaf1223b5bbc%252Fpa%252FWA74710_96f8915ea443461c46aadf84b79f4637.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_96f8915ea443461c46aadf84b79f4637.jpg saved to cache
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f71c55c9-2aa8-56a8-a2ad-edfe73063e08
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073859f9d0>
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64c3ab2a-279b-5692-ab68-e6db4c872a7b/64c3ab2a-279b-5692-ab68-e6db4c872a7b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c13718764c31d650bd79d11d131fad%252Fpa%252FTZ86489_6796dc71583b887851246fc7648def35.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_6796dc71583b887851246fc7648def35.jpg saved to cache
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 64c3ab2a-279b-5692-ab68-e6db4c872a7b
2026-03-30 11:17:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_f336230cb38b8fe9d957400876dea6c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_e532bdd12fa006b1ff0bfee292acd674.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384add50>
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64c3ab2a-279b-5692-ab68-e6db4c872a7b/64c3ab2a-279b-5692-ab68-e6db4c872a7b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c13718764c31d650bd79d11d131fad%252Fpa%252FTZ86489_f336230cb38b8fe9d957400876dea6c2.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_f336230cb38b8fe9d957400876dea6c2.jpg saved to cache
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 64c3ab2a-279b-5692-ab68-e6db4c872a7b
2026-03-30 11:17:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_b6f55f73064c7d6d498bcb333618560d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738532a50>
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64c3ab2a-279b-5692-ab68-e6db4c872a7b/64c3ab2a-279b-5692-ab68-e6db4c872a7b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c13718764c31d650bd79d11d131fad%252Fpa%252FTZ86489_e532bdd12fa006b1ff0bfee292acd674.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_e532bdd12fa006b1ff0bfee292acd674.jpg saved to cache
2026-03-30 11:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 64c3ab2a-279b-5692-ab68-e6db4c872a7b
2026-03-30 11:17:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_cd0d2e3c5eaefe639bf5df5c997de7cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738455410>
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64c3ab2a-279b-5692-ab68-e6db4c872a7b/64c3ab2a-279b-5692-ab68-e6db4c872a7b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c13718764c31d650bd79d11d131fad%252Fpa%252FTZ86489_b6f55f73064c7d6d498bcb333618560d.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_b6f55f73064c7d6d498bcb333618560d.jpg saved to cache
2026-03-30 11:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 64c3ab2a-279b-5692-ab68-e6db4c872a7b
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385d7f10>
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64c3ab2a-279b-5692-ab68-e6db4c872a7b/64c3ab2a-279b-5692-ab68-e6db4c872a7b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c13718764c31d650bd79d11d131fad%252Fpa%252FTZ86489_cd0d2e3c5eaefe639bf5df5c997de7cb.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_cd0d2e3c5eaefe639bf5df5c997de7cb.jpg saved to cache
2026-03-30 11:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 64c3ab2a-279b-5692-ab68-e6db4c872a7b
2026-03-30 11:17:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_8227ce289debf7ac2bc64ebdb119dbd3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_598749f1fd1cce9a6e101fe6f4302831.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_c23b5bc51e9820cbfff4fab1be0918cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_b9e54a4c80a57c4385ebc17853ed2e7c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738533150>
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64c3ab2a-279b-5692-ab68-e6db4c872a7b/64c3ab2a-279b-5692-ab68-e6db4c872a7b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c13718764c31d650bd79d11d131fad%252Fpa%252FTZ86489_8227ce289debf7ac2bc64ebdb119dbd3.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_8227ce289debf7ac2bc64ebdb119dbd3.jpg saved to cache
2026-03-30 11:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 64c3ab2a-279b-5692-ab68-e6db4c872a7b
2026-03-30 11:17:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_2da6d67e6a47da24e9f01a45bcc8ba05.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738724c10>
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64c3ab2a-279b-5692-ab68-e6db4c872a7b/64c3ab2a-279b-5692-ab68-e6db4c872a7b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c13718764c31d650bd79d11d131fad%252Fpa%252FTZ86489_598749f1fd1cce9a6e101fe6f4302831.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_598749f1fd1cce9a6e101fe6f4302831.jpg saved to cache
2026-03-30 11:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64c3ab2a-279b-5692-ab68-e6db4c872a7b
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383fd710>
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64c3ab2a-279b-5692-ab68-e6db4c872a7b/64c3ab2a-279b-5692-ab68-e6db4c872a7b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c13718764c31d650bd79d11d131fad%252Fpa%252FTZ86489_c23b5bc51e9820cbfff4fab1be0918cd.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_c23b5bc51e9820cbfff4fab1be0918cd.jpg saved to cache
2026-03-30 11:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64c3ab2a-279b-5692-ab68-e6db4c872a7b
2026-03-30 11:17:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_b1d8e134afd322c437638c9b72284bb1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738545250>
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64c3ab2a-279b-5692-ab68-e6db4c872a7b/64c3ab2a-279b-5692-ab68-e6db4c872a7b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c13718764c31d650bd79d11d131fad%252Fpa%252FTZ86489_b9e54a4c80a57c4385ebc17853ed2e7c.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_b9e54a4c80a57c4385ebc17853ed2e7c.jpg saved to cache
2026-03-30 11:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64c3ab2a-279b-5692-ab68-e6db4c872a7b
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073871f8d0>
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f71c55c9-2aa8-56a8-a2ad-edfe73063e08/f71c55c9-2aa8-56a8-a2ad-edfe73063e08_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F79%252F46794df1a0dbad0f47a5eaf1223b5bbc%252Fpa%252FWA74710_2da6d67e6a47da24e9f01a45bcc8ba05.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_2da6d67e6a47da24e9f01a45bcc8ba05.jpg saved to cache
2026-03-30 11:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f71c55c9-2aa8-56a8-a2ad-edfe73063e08
2026-03-30 11:17:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f71c55c9-2aa8-56a8-a2ad-edfe73063e08, skipping ID generation
2026-03-30 11:17:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f71c55c9-2aa8-56a8-a2ad-edfe73063e08 with scrape type 1
2026-03-30 11:17:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f71c55c9-2aa8-56a8-a2ad-edfe73063e08 sending to next pipeline
2026-03-30 11:17:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f71c55c9-2aa8-56a8-a2ad-edfe73063e08, identifier: WA74710
2026-03-30 11:17:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f71c55c9-2aa8-56a8-a2ad-edfe73063e08 with identifier: WA74710
2026-03-30 11:17:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f71c55c9-2aa8-56a8-a2ad-edfe73063e08 with identifier: WA74710
2026-03-30 11:17:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f71c55c9-2aa8-56a8-a2ad-edfe73063e08 with identifier: WA74710 to the API
2026-03-30 11:17:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_2da6d67e6a47da24e9f01a45bcc8ba05.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.9L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:20:38Z',
'fuel_type': 'diesel',
'id': 'f71c55c9-2aa8-56a8-a2ad-edfe73063e08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA74710',
'listing': 'auction',
'location': 'FR, Le Mée sur Seine',
'make': 'Seat',
'model': 'Toledo',
'odometer': 302242,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f71c55c9-2aa8-56a8-a2ad-edfe73063e08/f71c55c9-2aa8-56a8-a2ad-edfe73063e08_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82596,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_2da6d67e6a47da24e9f01a45bcc8ba05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f71c55c9-2aa8-56a8-a2ad-edfe73063e08/f71c55c9-2aa8-56a8-a2ad-edfe73063e08_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101227,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_1247c79fdf0f2507488f0470adac0d53.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f71c55c9-2aa8-56a8-a2ad-edfe73063e08/f71c55c9-2aa8-56a8-a2ad-edfe73063e08_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77870,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_96f8915ea443461c46aadf84b79f4637.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f71c55c9-2aa8-56a8-a2ad-edfe73063e08/f71c55c9-2aa8-56a8-a2ad-edfe73063e08_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68510,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_55964e70935b56239301d2c661e69bd9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f71c55c9-2aa8-56a8-a2ad-edfe73063e08/f71c55c9-2aa8-56a8-a2ad-edfe73063e08_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_60536e929d9ca408e7015852876361ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f71c55c9-2aa8-56a8-a2ad-edfe73063e08/f71c55c9-2aa8-56a8-a2ad-edfe73063e08_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43898,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/79/46794df1a0dbad0f47a5eaf1223b5bbc/pa/WA74710_ab756a7d4f69b5cd517866c1286ca113.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2001-12-27',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Toledo 1.9 TDI Stella',
'transmission': 'manual',
'trim': 'Stella',
'year': 2001}
2026-03-30 11:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA74710%27 HTTP/1.1" 200 None
2026-03-30 11:17:48 [auto1.fr] INFO: Saving data for WA74710: {'created_time': 1774869468.477076, 'last_price_update_time': 1774869468.477089, 'auction_closing_time': 1774970438.0}
2026-03-30 11:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WA74710') HTTP/1.1" 204 0
2026-03-30 11:17:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a4fc950>
2026-03-30 11:17:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64c3ab2a-279b-5692-ab68-e6db4c872a7b/64c3ab2a-279b-5692-ab68-e6db4c872a7b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c13718764c31d650bd79d11d131fad%252Fpa%252FTZ86489_b1d8e134afd322c437638c9b72284bb1.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_b1d8e134afd322c437638c9b72284bb1.jpg saved to cache
2026-03-30 11:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64c3ab2a-279b-5692-ab68-e6db4c872a7b
2026-03-30 11:17:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64c3ab2a-279b-5692-ab68-e6db4c872a7b, skipping ID generation
2026-03-30 11:17:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64c3ab2a-279b-5692-ab68-e6db4c872a7b with scrape type 1
2026-03-30 11:17:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64c3ab2a-279b-5692-ab68-e6db4c872a7b sending to next pipeline
2026-03-30 11:17:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 64c3ab2a-279b-5692-ab68-e6db4c872a7b, identifier: TZ86489
2026-03-30 11:17:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 64c3ab2a-279b-5692-ab68-e6db4c872a7b with identifier: TZ86489
2026-03-30 11:17:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 64c3ab2a-279b-5692-ab68-e6db4c872a7b with identifier: TZ86489
2026-03-30 11:17:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 64c3ab2a-279b-5692-ab68-e6db4c872a7b with identifier: TZ86489 to the API
2026-03-30 11:17:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_b1d8e134afd322c437638c9b72284bb1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:45:39Z',
'fuel_type': 'petrol',
'id': '64c3ab2a-279b-5692-ab68-e6db4c872a7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ86489',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 23292,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64c3ab2a-279b-5692-ab68-e6db4c872a7b/64c3ab2a-279b-5692-ab68-e6db4c872a7b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87490,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_b9e54a4c80a57c4385ebc17853ed2e7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64c3ab2a-279b-5692-ab68-e6db4c872a7b/64c3ab2a-279b-5692-ab68-e6db4c872a7b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90620,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_b1d8e134afd322c437638c9b72284bb1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64c3ab2a-279b-5692-ab68-e6db4c872a7b/64c3ab2a-279b-5692-ab68-e6db4c872a7b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87993,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_c23b5bc51e9820cbfff4fab1be0918cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64c3ab2a-279b-5692-ab68-e6db4c872a7b/64c3ab2a-279b-5692-ab68-e6db4c872a7b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35334,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_8227ce289debf7ac2bc64ebdb119dbd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64c3ab2a-279b-5692-ab68-e6db4c872a7b/64c3ab2a-279b-5692-ab68-e6db4c872a7b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46298,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_598749f1fd1cce9a6e101fe6f4302831.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64c3ab2a-279b-5692-ab68-e6db4c872a7b/64c3ab2a-279b-5692-ab68-e6db4c872a7b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_cd0d2e3c5eaefe639bf5df5c997de7cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64c3ab2a-279b-5692-ab68-e6db4c872a7b/64c3ab2a-279b-5692-ab68-e6db4c872a7b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78753,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_6796dc71583b887851246fc7648def35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64c3ab2a-279b-5692-ab68-e6db4c872a7b/64c3ab2a-279b-5692-ab68-e6db4c872a7b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89467,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_f336230cb38b8fe9d957400876dea6c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64c3ab2a-279b-5692-ab68-e6db4c872a7b/64c3ab2a-279b-5692-ab68-e6db4c872a7b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65850,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_b6f55f73064c7d6d498bcb333618560d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64c3ab2a-279b-5692-ab68-e6db4c872a7b/64c3ab2a-279b-5692-ab68-e6db4c872a7b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/c1/68c13718764c31d650bd79d11d131fad/pa/TZ86489_e532bdd12fa006b1ff0bfee292acd674.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2019}
2026-03-30 11:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ86489%27 HTTP/1.1" 200 None
2026-03-30 11:17:49 [auto1.fr] INFO: Saving data for TZ86489: {'created_time': 1774869469.055449, 'last_price_update_time': 1774869469.055461, 'auction_closing_time': 1774971939.0}
2026-03-30 11:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TZ86489') HTTP/1.1" 204 0
2026-03-30 11:17:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:17:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL70342> (referer: https://www.auto1.com/v1/car-details-view/NL70342/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b59e2df2-7de2-5077-aa25-47db0507a49d with identifier: NL70342
2026-03-30 11:17:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b59e2df2-7de2-5077-aa25-47db0507a49d with scrape type 1
2026-03-30 11:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b59e2df2-7de2-5077-aa25-47db0507a49d
2026-03-30 11:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F66%252Fab66399c864284b9d103f2f5996819c4%252Fpa%252FNL70342_f6d0f45899f6f2267e71ba3f8707907d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_f6d0f45899f6f2267e71ba3f8707907d.jpg already downloaded
2026-03-30 11:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F66%252Fab66399c864284b9d103f2f5996819c4%252Fpa%252FNL70342_539e997559a49ffc38cae1b6b32f836a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_539e997559a49ffc38cae1b6b32f836a.jpg already downloaded
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F66%252Fab66399c864284b9d103f2f5996819c4%252Fpa%252FNL70342_7fc8e416ee3d1be006b85b984dcb4915.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_7fc8e416ee3d1be006b85b984dcb4915.jpg already downloaded
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F66%252Fab66399c864284b9d103f2f5996819c4%252Fpa%252FNL70342_015741de99946d1bb587fbcb12dd074c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_015741de99946d1bb587fbcb12dd074c.jpg already downloaded
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F66%252Fab66399c864284b9d103f2f5996819c4%252Fpa%252FNL70342_232613894d777f27ec82544a6e3e235a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_232613894d777f27ec82544a6e3e235a.jpg already downloaded
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F66%252Fab66399c864284b9d103f2f5996819c4%252Fpa%252FNL70342_51435314eb727675022a97cdb0f2f517.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_51435314eb727675022a97cdb0f2f517.jpg already downloaded
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F66%252Fab66399c864284b9d103f2f5996819c4%252Fpa%252FNL70342_c0a2e2c8f2f8554ad6b5e691f6345c1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_c0a2e2c8f2f8554ad6b5e691f6345c1c.jpg already downloaded
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F66%252Fab66399c864284b9d103f2f5996819c4%252Fpa%252FNL70342_a6e80cbb65412d230646bebbac4ece5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_a6e80cbb65412d230646bebbac4ece5d.jpg already downloaded
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F66%252Fab66399c864284b9d103f2f5996819c4%252Fpa%252FNL70342_54e19469a601136dd4248e7fce4687df.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_54e19469a601136dd4248e7fce4687df.jpg already downloaded
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F66%252Fab66399c864284b9d103f2f5996819c4%252Fpa%252FNL70342_845de2436dab0ed82c5969d4ef50f26b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_845de2436dab0ed82c5969d4ef50f26b.jpg already downloaded
2026-03-30 11:17:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b59e2df2-7de2-5077-aa25-47db0507a49d, identifier: NL70342
2026-03-30 11:17:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b59e2df2-7de2-5077-aa25-47db0507a49d with identifier: NL70342
2026-03-30 11:17:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b59e2df2-7de2-5077-aa25-47db0507a49d with identifier: NL70342
2026-03-30 11:17:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b59e2df2-7de2-5077-aa25-47db0507a49d with identifier: NL70342 to the API
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NL70342>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:41:03Z',
'fuel_type': 'petrol',
'id': 'b59e2df2-7de2-5077-aa25-47db0507a49d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL70342',
'listing': 'auction',
'location': 'FR, Saint Aignan de Grandlieu',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 159892,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_f6d0f45899f6f2267e71ba3f8707907d.jpg',
'https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_539e997559a49ffc38cae1b6b32f836a.jpg',
'https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_7fc8e416ee3d1be006b85b984dcb4915.jpg',
'https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_015741de99946d1bb587fbcb12dd074c.jpg',
'https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_232613894d777f27ec82544a6e3e235a.jpg',
'https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_51435314eb727675022a97cdb0f2f517.jpg',
'https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_c0a2e2c8f2f8554ad6b5e691f6345c1c.jpg',
'https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_a6e80cbb65412d230646bebbac4ece5d.jpg',
'https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_54e19469a601136dd4248e7fce4687df.jpg',
'https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_845de2436dab0ed82c5969d4ef50f26b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59e2df2-7de2-5077-aa25-47db0507a49d/b59e2df2-7de2-5077-aa25-47db0507a49d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79617,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_f6d0f45899f6f2267e71ba3f8707907d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59e2df2-7de2-5077-aa25-47db0507a49d/b59e2df2-7de2-5077-aa25-47db0507a49d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70954,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_539e997559a49ffc38cae1b6b32f836a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59e2df2-7de2-5077-aa25-47db0507a49d/b59e2df2-7de2-5077-aa25-47db0507a49d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_7fc8e416ee3d1be006b85b984dcb4915.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59e2df2-7de2-5077-aa25-47db0507a49d/b59e2df2-7de2-5077-aa25-47db0507a49d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65413,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_015741de99946d1bb587fbcb12dd074c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59e2df2-7de2-5077-aa25-47db0507a49d/b59e2df2-7de2-5077-aa25-47db0507a49d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2645848,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_232613894d777f27ec82544a6e3e235a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59e2df2-7de2-5077-aa25-47db0507a49d/b59e2df2-7de2-5077-aa25-47db0507a49d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2685832,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_51435314eb727675022a97cdb0f2f517.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59e2df2-7de2-5077-aa25-47db0507a49d/b59e2df2-7de2-5077-aa25-47db0507a49d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2693931,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_c0a2e2c8f2f8554ad6b5e691f6345c1c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59e2df2-7de2-5077-aa25-47db0507a49d/b59e2df2-7de2-5077-aa25-47db0507a49d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2852099,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_a6e80cbb65412d230646bebbac4ece5d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59e2df2-7de2-5077-aa25-47db0507a49d/b59e2df2-7de2-5077-aa25-47db0507a49d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76902,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_54e19469a601136dd4248e7fce4687df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59e2df2-7de2-5077-aa25-47db0507a49d/b59e2df2-7de2-5077-aa25-47db0507a49d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/66/ab66399c864284b9d103f2f5996819c4/pa/NL70342_845de2436dab0ed82c5969d4ef50f26b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-14',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Kodiaq 1.5 TSI ACT Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2019}
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL70342%27 HTTP/1.1" 200 None
2026-03-30 11:17:50 [auto1.fr] INFO: Saving data for NL70342: {'created_time': 1774869470.552459, 'last_price_update_time': 1774869470.552471, 'auction_closing_time': 1774971663.0}
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NL70342') HTTP/1.1" 204 0
2026-03-30 11:17:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YX07310> (referer: https://www.auto1.com/v1/car-details-view/YX07310/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4b128b2-3f8f-5afd-a6ba-c61fe5f65956 with identifier: YX07310
2026-03-30 11:17:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4b128b2-3f8f-5afd-a6ba-c61fe5f65956 with scrape type 1
2026-03-30 11:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c4b128b2-3f8f-5afd-a6ba-c61fe5f65956
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F5c%252F395c53da7c3332f8c58d86dcd4620665%252Fpa%252FYX07310_d66aa0efcb8271dc3ed66fc2f5e29dd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_d66aa0efcb8271dc3ed66fc2f5e29dd7.jpg not downloaded yet
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F5c%252F395c53da7c3332f8c58d86dcd4620665%252Fpa%252FYX07310_b8489c4bd4705b8fde12e554d5978e70.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_b8489c4bd4705b8fde12e554d5978e70.jpg not downloaded yet
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F5c%252F395c53da7c3332f8c58d86dcd4620665%252Fpa%252FYX07310_665c75e5ea7dd7f5a65151f0a24c69aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_665c75e5ea7dd7f5a65151f0a24c69aa.jpg not downloaded yet
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F5c%252F395c53da7c3332f8c58d86dcd4620665%252Fpa%252FYX07310_f37b823d4514cdd2792c3917e6e61ec9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_f37b823d4514cdd2792c3917e6e61ec9.jpg not downloaded yet
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F5c%252F395c53da7c3332f8c58d86dcd4620665%252Fpa%252FYX07310_a0be9308b4d1db2ff3e07381b8127a29.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_a0be9308b4d1db2ff3e07381b8127a29.jpg not downloaded yet
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F5c%252F395c53da7c3332f8c58d86dcd4620665%252Fpa%252FYX07310_6f5aa2d7792f11b5f87395fb0f7976cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_6f5aa2d7792f11b5f87395fb0f7976cf.jpg not downloaded yet
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F5c%252F395c53da7c3332f8c58d86dcd4620665%252Fpa%252FYX07310_181deb3401953238e689e173c4ef4ec1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_181deb3401953238e689e173c4ef4ec1.jpg not downloaded yet
2026-03-30 11:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_d66aa0efcb8271dc3ed66fc2f5e29dd7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F5c%252F395c53da7c3332f8c58d86dcd4620665%252Fpa%252FYX07310_29ece902cee555bbf3a0c6f749bf6c9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_29ece902cee555bbf3a0c6f749bf6c9e.jpg not downloaded yet
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F5c%252F395c53da7c3332f8c58d86dcd4620665%252Fpa%252FYX07310_af18202d098dac5a19f04042d4ecc0c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_af18202d098dac5a19f04042d4ecc0c7.jpg not downloaded yet
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F5c%252F395c53da7c3332f8c58d86dcd4620665%252Fpa%252FYX07310_d8695c270f8e5991e796260f8ff252de.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_d8695c270f8e5991e796260f8ff252de.jpg not downloaded yet
2026-03-30 11:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_181deb3401953238e689e173c4ef4ec1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_b8489c4bd4705b8fde12e554d5978e70.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384556d0>
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b128b2-3f8f-5afd-a6ba-c61fe5f65956/c4b128b2-3f8f-5afd-a6ba-c61fe5f65956_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F5c%252F395c53da7c3332f8c58d86dcd4620665%252Fpa%252FYX07310_d66aa0efcb8271dc3ed66fc2f5e29dd7.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_d66aa0efcb8271dc3ed66fc2f5e29dd7.jpg saved to cache
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c4b128b2-3f8f-5afd-a6ba-c61fe5f65956
2026-03-30 11:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_665c75e5ea7dd7f5a65151f0a24c69aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_d8695c270f8e5991e796260f8ff252de.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_f37b823d4514cdd2792c3917e6e61ec9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383b05d0>
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b128b2-3f8f-5afd-a6ba-c61fe5f65956/c4b128b2-3f8f-5afd-a6ba-c61fe5f65956_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F5c%252F395c53da7c3332f8c58d86dcd4620665%252Fpa%252FYX07310_181deb3401953238e689e173c4ef4ec1.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_181deb3401953238e689e173c4ef4ec1.jpg saved to cache
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c4b128b2-3f8f-5afd-a6ba-c61fe5f65956
2026-03-30 11:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_a0be9308b4d1db2ff3e07381b8127a29.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_af18202d098dac5a19f04042d4ecc0c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385bfe50>
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b128b2-3f8f-5afd-a6ba-c61fe5f65956/c4b128b2-3f8f-5afd-a6ba-c61fe5f65956_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F5c%252F395c53da7c3332f8c58d86dcd4620665%252Fpa%252FYX07310_b8489c4bd4705b8fde12e554d5978e70.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_b8489c4bd4705b8fde12e554d5978e70.jpg saved to cache
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c4b128b2-3f8f-5afd-a6ba-c61fe5f65956
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385cfc50>
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b128b2-3f8f-5afd-a6ba-c61fe5f65956/c4b128b2-3f8f-5afd-a6ba-c61fe5f65956_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F5c%252F395c53da7c3332f8c58d86dcd4620665%252Fpa%252FYX07310_665c75e5ea7dd7f5a65151f0a24c69aa.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_665c75e5ea7dd7f5a65151f0a24c69aa.jpg saved to cache
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c4b128b2-3f8f-5afd-a6ba-c61fe5f65956
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738587a50>
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b128b2-3f8f-5afd-a6ba-c61fe5f65956/c4b128b2-3f8f-5afd-a6ba-c61fe5f65956_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F5c%252F395c53da7c3332f8c58d86dcd4620665%252Fpa%252FYX07310_d8695c270f8e5991e796260f8ff252de.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_d8695c270f8e5991e796260f8ff252de.jpg saved to cache
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c4b128b2-3f8f-5afd-a6ba-c61fe5f65956
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383d1950>
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b128b2-3f8f-5afd-a6ba-c61fe5f65956/c4b128b2-3f8f-5afd-a6ba-c61fe5f65956_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F5c%252F395c53da7c3332f8c58d86dcd4620665%252Fpa%252FYX07310_f37b823d4514cdd2792c3917e6e61ec9.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_f37b823d4514cdd2792c3917e6e61ec9.jpg saved to cache
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c4b128b2-3f8f-5afd-a6ba-c61fe5f65956
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738724f50>
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b128b2-3f8f-5afd-a6ba-c61fe5f65956/c4b128b2-3f8f-5afd-a6ba-c61fe5f65956_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F5c%252F395c53da7c3332f8c58d86dcd4620665%252Fpa%252FYX07310_a0be9308b4d1db2ff3e07381b8127a29.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_a0be9308b4d1db2ff3e07381b8127a29.jpg saved to cache
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c4b128b2-3f8f-5afd-a6ba-c61fe5f65956
2026-03-30 11:17:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073842ef10>
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b128b2-3f8f-5afd-a6ba-c61fe5f65956/c4b128b2-3f8f-5afd-a6ba-c61fe5f65956_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F5c%252F395c53da7c3332f8c58d86dcd4620665%252Fpa%252FYX07310_af18202d098dac5a19f04042d4ecc0c7.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_af18202d098dac5a19f04042d4ecc0c7.jpg saved to cache
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c4b128b2-3f8f-5afd-a6ba-c61fe5f65956
2026-03-30 11:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_29ece902cee555bbf3a0c6f749bf6c9e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_6f5aa2d7792f11b5f87395fb0f7976cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384c1b50>
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b128b2-3f8f-5afd-a6ba-c61fe5f65956/c4b128b2-3f8f-5afd-a6ba-c61fe5f65956_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F5c%252F395c53da7c3332f8c58d86dcd4620665%252Fpa%252FYX07310_29ece902cee555bbf3a0c6f749bf6c9e.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_29ece902cee555bbf3a0c6f749bf6c9e.jpg saved to cache
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c4b128b2-3f8f-5afd-a6ba-c61fe5f65956
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384bf810>
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b128b2-3f8f-5afd-a6ba-c61fe5f65956/c4b128b2-3f8f-5afd-a6ba-c61fe5f65956_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F5c%252F395c53da7c3332f8c58d86dcd4620665%252Fpa%252FYX07310_6f5aa2d7792f11b5f87395fb0f7976cf.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_6f5aa2d7792f11b5f87395fb0f7976cf.jpg saved to cache
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c4b128b2-3f8f-5afd-a6ba-c61fe5f65956
2026-03-30 11:17:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c4b128b2-3f8f-5afd-a6ba-c61fe5f65956, skipping ID generation
2026-03-30 11:17:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4b128b2-3f8f-5afd-a6ba-c61fe5f65956 with scrape type 1
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c4b128b2-3f8f-5afd-a6ba-c61fe5f65956 sending to next pipeline
2026-03-30 11:17:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c4b128b2-3f8f-5afd-a6ba-c61fe5f65956, identifier: YX07310
2026-03-30 11:17:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c4b128b2-3f8f-5afd-a6ba-c61fe5f65956 with identifier: YX07310
2026-03-30 11:17:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c4b128b2-3f8f-5afd-a6ba-c61fe5f65956 with identifier: YX07310
2026-03-30 11:17:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c4b128b2-3f8f-5afd-a6ba-c61fe5f65956 with identifier: YX07310 to the API
2026-03-30 11:17:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_6f5aa2d7792f11b5f87395fb0f7976cf.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:47:21Z',
'fuel_type': 'petrol',
'id': 'c4b128b2-3f8f-5afd-a6ba-c61fe5f65956',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX07310',
'listing': 'auction',
'location': 'FR, Coudekerque-Branche',
'make': 'Chevrolet',
'model': 'Spark',
'odometer': 59028,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b128b2-3f8f-5afd-a6ba-c61fe5f65956/c4b128b2-3f8f-5afd-a6ba-c61fe5f65956_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_d66aa0efcb8271dc3ed66fc2f5e29dd7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b128b2-3f8f-5afd-a6ba-c61fe5f65956/c4b128b2-3f8f-5afd-a6ba-c61fe5f65956_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2981709,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_b8489c4bd4705b8fde12e554d5978e70.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b128b2-3f8f-5afd-a6ba-c61fe5f65956/c4b128b2-3f8f-5afd-a6ba-c61fe5f65956_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79409,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_665c75e5ea7dd7f5a65151f0a24c69aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b128b2-3f8f-5afd-a6ba-c61fe5f65956/c4b128b2-3f8f-5afd-a6ba-c61fe5f65956_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59360,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_f37b823d4514cdd2792c3917e6e61ec9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b128b2-3f8f-5afd-a6ba-c61fe5f65956/c4b128b2-3f8f-5afd-a6ba-c61fe5f65956_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67717,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_a0be9308b4d1db2ff3e07381b8127a29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b128b2-3f8f-5afd-a6ba-c61fe5f65956/c4b128b2-3f8f-5afd-a6ba-c61fe5f65956_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79214,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_6f5aa2d7792f11b5f87395fb0f7976cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b128b2-3f8f-5afd-a6ba-c61fe5f65956/c4b128b2-3f8f-5afd-a6ba-c61fe5f65956_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74649,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_181deb3401953238e689e173c4ef4ec1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b128b2-3f8f-5afd-a6ba-c61fe5f65956/c4b128b2-3f8f-5afd-a6ba-c61fe5f65956_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88369,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_29ece902cee555bbf3a0c6f749bf6c9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b128b2-3f8f-5afd-a6ba-c61fe5f65956/c4b128b2-3f8f-5afd-a6ba-c61fe5f65956_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3187934,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_af18202d098dac5a19f04042d4ecc0c7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b128b2-3f8f-5afd-a6ba-c61fe5f65956/c4b128b2-3f8f-5afd-a6ba-c61fe5f65956_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/5c/395c53da7c3332f8c58d86dcd4620665/pa/YX07310_d8695c270f8e5991e796260f8ff252de.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-05-26',
'seats_number': 5,
'seller_name': None,
'title': 'Chevrolet Spark 1.2 LTZ',
'transmission': 'manual',
'trim': 'LTZ',
'year': 2013}
2026-03-30 11:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX07310%27 HTTP/1.1" 200 None
2026-03-30 11:17:53 [auto1.fr] INFO: Saving data for YX07310: {'created_time': 1774869473.389, 'last_price_update_time': 1774869473.38901, 'auction_closing_time': 1774972041.0}
2026-03-30 11:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YX07310') HTTP/1.1" 204 0
2026-03-30 11:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VT02723> (referer: https://www.auto1.com/v1/car-details-view/VT02723/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa690fbf-7811-51bc-a490-8953cc3bb357 with identifier: VT02723
2026-03-30 11:17:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa690fbf-7811-51bc-a490-8953cc3bb357 with scrape type 1
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa690fbf-7811-51bc-a490-8953cc3bb357
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F34%252F493452e99a42a74600489b969c6dc379%252Fpa%252FVT02723_e1f71498fcc1e1a02e4627d0f5fac37d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_e1f71498fcc1e1a02e4627d0f5fac37d.jpg not downloaded yet
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F34%252F493452e99a42a74600489b969c6dc379%252Fpa%252FVT02723_77fbaa8d5fb1287edd998d46a8882aa6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_77fbaa8d5fb1287edd998d46a8882aa6.jpg not downloaded yet
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F34%252F493452e99a42a74600489b969c6dc379%252Fpa%252FVT02723_e88e0ff3191d6faebb5270ad117033a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_e88e0ff3191d6faebb5270ad117033a0.jpg not downloaded yet
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F34%252F493452e99a42a74600489b969c6dc379%252Fpa%252FVT02723_510d2fe448aa35b683e5760c4b88635c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_510d2fe448aa35b683e5760c4b88635c.jpg not downloaded yet
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F34%252F493452e99a42a74600489b969c6dc379%252Fpa%252FVT02723_c75d0b8d377461141bb6b12f3c7bd583.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_c75d0b8d377461141bb6b12f3c7bd583.jpg not downloaded yet
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F34%252F493452e99a42a74600489b969c6dc379%252Fpa%252FVT02723_98e0e2f63a3a4ce1c328601bc32b905a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_98e0e2f63a3a4ce1c328601bc32b905a.jpg not downloaded yet
2026-03-30 11:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_e1f71498fcc1e1a02e4627d0f5fac37d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F34%252F493452e99a42a74600489b969c6dc379%252Fpa%252FVT02723_0e425e8ffdaf56a511661775a8c123a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_0e425e8ffdaf56a511661775a8c123a0.jpg not downloaded yet
2026-03-30 11:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_e88e0ff3191d6faebb5270ad117033a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_77fbaa8d5fb1287edd998d46a8882aa6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F34%252F493452e99a42a74600489b969c6dc379%252Fpa%252FVT02723_5d2d2370e0d9abeb4763e1504e3c3362.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_5d2d2370e0d9abeb4763e1504e3c3362.jpg not downloaded yet
2026-03-30 11:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_510d2fe448aa35b683e5760c4b88635c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F34%252F493452e99a42a74600489b969c6dc379%252Fpa%252FVT02723_9bb908f3db54d6acb96e819fa919484d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_9bb908f3db54d6acb96e819fa919484d.jpg not downloaded yet
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F34%252F493452e99a42a74600489b969c6dc379%252Fpa%252FVT02723_7b68e1b352fb842271ac7f534594c88a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_7b68e1b352fb842271ac7f534594c88a.jpg not downloaded yet
2026-03-30 11:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_0e425e8ffdaf56a511661775a8c123a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_5d2d2370e0d9abeb4763e1504e3c3362.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a536390>
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F34%252F493452e99a42a74600489b969c6dc379%252Fpa%252FVT02723_e1f71498fcc1e1a02e4627d0f5fac37d.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_e1f71498fcc1e1a02e4627d0f5fac37d.jpg saved to cache
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa690fbf-7811-51bc-a490-8953cc3bb357
2026-03-30 11:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_7b68e1b352fb842271ac7f534594c88a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738554b90>
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F34%252F493452e99a42a74600489b969c6dc379%252Fpa%252FVT02723_e88e0ff3191d6faebb5270ad117033a0.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_e88e0ff3191d6faebb5270ad117033a0.jpg saved to cache
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa690fbf-7811-51bc-a490-8953cc3bb357
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384461d0>
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F34%252F493452e99a42a74600489b969c6dc379%252Fpa%252FVT02723_77fbaa8d5fb1287edd998d46a8882aa6.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_77fbaa8d5fb1287edd998d46a8882aa6.jpg saved to cache
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa690fbf-7811-51bc-a490-8953cc3bb357
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385eb5d0>
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F34%252F493452e99a42a74600489b969c6dc379%252Fpa%252FVT02723_510d2fe448aa35b683e5760c4b88635c.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_510d2fe448aa35b683e5760c4b88635c.jpg saved to cache
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa690fbf-7811-51bc-a490-8953cc3bb357
2026-03-30 11:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_98e0e2f63a3a4ce1c328601bc32b905a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_9bb908f3db54d6acb96e819fa919484d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_c75d0b8d377461141bb6b12f3c7bd583.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383bea10>
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F34%252F493452e99a42a74600489b969c6dc379%252Fpa%252FVT02723_0e425e8ffdaf56a511661775a8c123a0.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_0e425e8ffdaf56a511661775a8c123a0.jpg saved to cache
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa690fbf-7811-51bc-a490-8953cc3bb357
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738776110>
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F34%252F493452e99a42a74600489b969c6dc379%252Fpa%252FVT02723_5d2d2370e0d9abeb4763e1504e3c3362.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_5d2d2370e0d9abeb4763e1504e3c3362.jpg saved to cache
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa690fbf-7811-51bc-a490-8953cc3bb357
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073856d190>
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F34%252F493452e99a42a74600489b969c6dc379%252Fpa%252FVT02723_7b68e1b352fb842271ac7f534594c88a.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_7b68e1b352fb842271ac7f534594c88a.jpg saved to cache
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa690fbf-7811-51bc-a490-8953cc3bb357
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738595690>
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F34%252F493452e99a42a74600489b969c6dc379%252Fpa%252FVT02723_98e0e2f63a3a4ce1c328601bc32b905a.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_98e0e2f63a3a4ce1c328601bc32b905a.jpg saved to cache
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa690fbf-7811-51bc-a490-8953cc3bb357
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073860b290>
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F34%252F493452e99a42a74600489b969c6dc379%252Fpa%252FVT02723_9bb908f3db54d6acb96e819fa919484d.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_9bb908f3db54d6acb96e819fa919484d.jpg saved to cache
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa690fbf-7811-51bc-a490-8953cc3bb357
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738534850>
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F34%252F493452e99a42a74600489b969c6dc379%252Fpa%252FVT02723_c75d0b8d377461141bb6b12f3c7bd583.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_c75d0b8d377461141bb6b12f3c7bd583.jpg saved to cache
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa690fbf-7811-51bc-a490-8953cc3bb357
2026-03-30 11:17:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa690fbf-7811-51bc-a490-8953cc3bb357, skipping ID generation
2026-03-30 11:17:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa690fbf-7811-51bc-a490-8953cc3bb357 with scrape type 1
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa690fbf-7811-51bc-a490-8953cc3bb357 sending to next pipeline
2026-03-30 11:17:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fa690fbf-7811-51bc-a490-8953cc3bb357, identifier: VT02723
2026-03-30 11:17:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fa690fbf-7811-51bc-a490-8953cc3bb357 with identifier: VT02723
2026-03-30 11:17:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fa690fbf-7811-51bc-a490-8953cc3bb357 with identifier: VT02723
2026-03-30 11:18:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fa690fbf-7811-51bc-a490-8953cc3bb357 with identifier: VT02723 to the API
2026-03-30 11:18:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_c75d0b8d377461141bb6b12f3c7bd583.jpg>
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:14:24Z',
'fuel_type': 'diesel',
'id': 'fa690fbf-7811-51bc-a490-8953cc3bb357',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT02723',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Peugeot',
'model': '308',
'odometer': 143939,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45147,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_e1f71498fcc1e1a02e4627d0f5fac37d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47462,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_77fbaa8d5fb1287edd998d46a8882aa6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43437,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_e88e0ff3191d6faebb5270ad117033a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37952,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_510d2fe448aa35b683e5760c4b88635c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45298,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_c75d0b8d377461141bb6b12f3c7bd583.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48854,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_98e0e2f63a3a4ce1c328601bc32b905a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41988,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_0e425e8ffdaf56a511661775a8c123a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103209,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_5d2d2370e0d9abeb4763e1504e3c3362.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_9bb908f3db54d6acb96e819fa919484d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa690fbf-7811-51bc-a490-8953cc3bb357/fa690fbf-7811-51bc-a490-8953cc3bb357_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79819,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/34/493452e99a42a74600489b969c6dc379/pa/VT02723_7b68e1b352fb842271ac7f534594c88a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-04',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2018}
2026-03-30 11:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT02723%27 HTTP/1.1" 200 None
2026-03-30 11:18:00 [auto1.fr] INFO: Saving data for VT02723: {'created_time': 1774869480.505016, 'last_price_update_time': 1774869480.505029, 'auction_closing_time': 1774970064.0}
2026-03-30 11:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VT02723') HTTP/1.1" 204 0
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EZ54447> (referer: https://www.auto1.com/v1/car-details-view/EZ54447/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74745deb-58d2-5a36-b33b-454001ac41c2 with identifier: EZ54447
2026-03-30 11:18:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74745deb-58d2-5a36-b33b-454001ac41c2 with scrape type 1
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74745deb-58d2-5a36-b33b-454001ac41c2
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F98%252F30984c50854e3a00eb0b942d23db395c%252Fpa%252FEZ54447_2f634663b58bf6c9ba76f78562e8f3c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_2f634663b58bf6c9ba76f78562e8f3c1.jpg not downloaded yet
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F98%252F30984c50854e3a00eb0b942d23db395c%252Fpa%252FEZ54447_b2b9919bb6e94bfb6d2b6cb6357b301a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_b2b9919bb6e94bfb6d2b6cb6357b301a.jpg not downloaded yet
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F98%252F30984c50854e3a00eb0b942d23db395c%252Fpa%252FEZ54447_5c6d03075ebcd000d2bdcc3937697b73.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_5c6d03075ebcd000d2bdcc3937697b73.jpg not downloaded yet
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F98%252F30984c50854e3a00eb0b942d23db395c%252Fpa%252FEZ54447_f69886b47ecd57e35b47699e68957df0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_f69886b47ecd57e35b47699e68957df0.jpg not downloaded yet
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F98%252F30984c50854e3a00eb0b942d23db395c%252Fpa%252FEZ54447_7edfd3d63f2d4800574d198a4c3e6d89.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_7edfd3d63f2d4800574d198a4c3e6d89.jpg not downloaded yet
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F98%252F30984c50854e3a00eb0b942d23db395c%252Fpa%252FEZ54447_3e482eba0707739e6a05f7d34bf00387.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_3e482eba0707739e6a05f7d34bf00387.jpg not downloaded yet
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F98%252F30984c50854e3a00eb0b942d23db395c%252Fpa%252FEZ54447_55a4014ce3177222488b9997c70f1029.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_55a4014ce3177222488b9997c70f1029.jpg not downloaded yet
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_2f634663b58bf6c9ba76f78562e8f3c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_b2b9919bb6e94bfb6d2b6cb6357b301a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F98%252F30984c50854e3a00eb0b942d23db395c%252Fpa%252FEZ54447_eb1363277610d3700c4a4eaf2995920b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_eb1363277610d3700c4a4eaf2995920b.jpg not downloaded yet
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_5c6d03075ebcd000d2bdcc3937697b73.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F98%252F30984c50854e3a00eb0b942d23db395c%252Fpa%252FEZ54447_37842c72e02d883e725114c494fc94ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_37842c72e02d883e725114c494fc94ab.jpg not downloaded yet
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_7edfd3d63f2d4800574d198a4c3e6d89.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_f69886b47ecd57e35b47699e68957df0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F98%252F30984c50854e3a00eb0b942d23db395c%252Fpa%252FEZ54447_9d94e668dc322210df3e7532ac086379.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_9d94e668dc322210df3e7532ac086379.jpg not downloaded yet
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_55a4014ce3177222488b9997c70f1029.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_eb1363277610d3700c4a4eaf2995920b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a4f7e10>
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74745deb-58d2-5a36-b33b-454001ac41c2/74745deb-58d2-5a36-b33b-454001ac41c2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F98%252F30984c50854e3a00eb0b942d23db395c%252Fpa%252FEZ54447_2f634663b58bf6c9ba76f78562e8f3c1.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_2f634663b58bf6c9ba76f78562e8f3c1.jpg saved to cache
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74745deb-58d2-5a36-b33b-454001ac41c2
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738466610>
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74745deb-58d2-5a36-b33b-454001ac41c2/74745deb-58d2-5a36-b33b-454001ac41c2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F98%252F30984c50854e3a00eb0b942d23db395c%252Fpa%252FEZ54447_b2b9919bb6e94bfb6d2b6cb6357b301a.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_b2b9919bb6e94bfb6d2b6cb6357b301a.jpg saved to cache
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74745deb-58d2-5a36-b33b-454001ac41c2
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_37842c72e02d883e725114c494fc94ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_9d94e668dc322210df3e7532ac086379.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073853b210>
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74745deb-58d2-5a36-b33b-454001ac41c2/74745deb-58d2-5a36-b33b-454001ac41c2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F98%252F30984c50854e3a00eb0b942d23db395c%252Fpa%252FEZ54447_5c6d03075ebcd000d2bdcc3937697b73.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_5c6d03075ebcd000d2bdcc3937697b73.jpg saved to cache
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74745deb-58d2-5a36-b33b-454001ac41c2
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384adad0>
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74745deb-58d2-5a36-b33b-454001ac41c2/74745deb-58d2-5a36-b33b-454001ac41c2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F98%252F30984c50854e3a00eb0b942d23db395c%252Fpa%252FEZ54447_7edfd3d63f2d4800574d198a4c3e6d89.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_7edfd3d63f2d4800574d198a4c3e6d89.jpg saved to cache
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74745deb-58d2-5a36-b33b-454001ac41c2
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a7e8e10>
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74745deb-58d2-5a36-b33b-454001ac41c2/74745deb-58d2-5a36-b33b-454001ac41c2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F98%252F30984c50854e3a00eb0b942d23db395c%252Fpa%252FEZ54447_f69886b47ecd57e35b47699e68957df0.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_f69886b47ecd57e35b47699e68957df0.jpg saved to cache
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74745deb-58d2-5a36-b33b-454001ac41c2
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384b0c50>
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74745deb-58d2-5a36-b33b-454001ac41c2/74745deb-58d2-5a36-b33b-454001ac41c2_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F98%252F30984c50854e3a00eb0b942d23db395c%252Fpa%252FEZ54447_55a4014ce3177222488b9997c70f1029.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_55a4014ce3177222488b9997c70f1029.jpg saved to cache
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74745deb-58d2-5a36-b33b-454001ac41c2
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384ae6d0>
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74745deb-58d2-5a36-b33b-454001ac41c2/74745deb-58d2-5a36-b33b-454001ac41c2_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F98%252F30984c50854e3a00eb0b942d23db395c%252Fpa%252FEZ54447_eb1363277610d3700c4a4eaf2995920b.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_eb1363277610d3700c4a4eaf2995920b.jpg saved to cache
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74745deb-58d2-5a36-b33b-454001ac41c2
2026-03-30 11:18:05 [scrapy.extensions.logstats] INFO: Crawled 113 pages (at 19 pages/min), scraped 94 items (at 11 items/min)
2026-03-30 11:18:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HN32336/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_3e482eba0707739e6a05f7d34bf00387.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a7fa5d0>
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74745deb-58d2-5a36-b33b-454001ac41c2/74745deb-58d2-5a36-b33b-454001ac41c2_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F98%252F30984c50854e3a00eb0b942d23db395c%252Fpa%252FEZ54447_37842c72e02d883e725114c494fc94ab.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_37842c72e02d883e725114c494fc94ab.jpg saved to cache
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 74745deb-58d2-5a36-b33b-454001ac41c2
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073bc46490>
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74745deb-58d2-5a36-b33b-454001ac41c2/74745deb-58d2-5a36-b33b-454001ac41c2_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F98%252F30984c50854e3a00eb0b942d23db395c%252Fpa%252FEZ54447_9d94e668dc322210df3e7532ac086379.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_9d94e668dc322210df3e7532ac086379.jpg saved to cache
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 74745deb-58d2-5a36-b33b-454001ac41c2
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073878ac50>
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74745deb-58d2-5a36-b33b-454001ac41c2/74745deb-58d2-5a36-b33b-454001ac41c2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F98%252F30984c50854e3a00eb0b942d23db395c%252Fpa%252FEZ54447_3e482eba0707739e6a05f7d34bf00387.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_3e482eba0707739e6a05f7d34bf00387.jpg saved to cache
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74745deb-58d2-5a36-b33b-454001ac41c2
2026-03-30 11:18:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74745deb-58d2-5a36-b33b-454001ac41c2, skipping ID generation
2026-03-30 11:18:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74745deb-58d2-5a36-b33b-454001ac41c2 with scrape type 1
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74745deb-58d2-5a36-b33b-454001ac41c2 sending to next pipeline
2026-03-30 11:18:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 74745deb-58d2-5a36-b33b-454001ac41c2, identifier: EZ54447
2026-03-30 11:18:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 74745deb-58d2-5a36-b33b-454001ac41c2 with identifier: EZ54447
2026-03-30 11:18:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 74745deb-58d2-5a36-b33b-454001ac41c2 with identifier: EZ54447
2026-03-30 11:18:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 74745deb-58d2-5a36-b33b-454001ac41c2 with identifier: EZ54447 to the API
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_3e482eba0707739e6a05f7d34bf00387.jpg>
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2026-03-31T15:55:56Z',
'fuel_type': 'diesel',
'id': '74745deb-58d2-5a36-b33b-454001ac41c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ54447',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Peugeot',
'model': 'Partner',
'odometer': 97215,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74745deb-58d2-5a36-b33b-454001ac41c2/74745deb-58d2-5a36-b33b-454001ac41c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43605,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_2f634663b58bf6c9ba76f78562e8f3c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74745deb-58d2-5a36-b33b-454001ac41c2/74745deb-58d2-5a36-b33b-454001ac41c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47364,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_b2b9919bb6e94bfb6d2b6cb6357b301a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74745deb-58d2-5a36-b33b-454001ac41c2/74745deb-58d2-5a36-b33b-454001ac41c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78420,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_5c6d03075ebcd000d2bdcc3937697b73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74745deb-58d2-5a36-b33b-454001ac41c2/74745deb-58d2-5a36-b33b-454001ac41c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_f69886b47ecd57e35b47699e68957df0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74745deb-58d2-5a36-b33b-454001ac41c2/74745deb-58d2-5a36-b33b-454001ac41c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37776,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_7edfd3d63f2d4800574d198a4c3e6d89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74745deb-58d2-5a36-b33b-454001ac41c2/74745deb-58d2-5a36-b33b-454001ac41c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_3e482eba0707739e6a05f7d34bf00387.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74745deb-58d2-5a36-b33b-454001ac41c2/74745deb-58d2-5a36-b33b-454001ac41c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40462,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_55a4014ce3177222488b9997c70f1029.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74745deb-58d2-5a36-b33b-454001ac41c2/74745deb-58d2-5a36-b33b-454001ac41c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80897,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_eb1363277610d3700c4a4eaf2995920b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74745deb-58d2-5a36-b33b-454001ac41c2/74745deb-58d2-5a36-b33b-454001ac41c2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59470,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_37842c72e02d883e725114c494fc94ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74745deb-58d2-5a36-b33b-454001ac41c2/74745deb-58d2-5a36-b33b-454001ac41c2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54269,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/98/30984c50854e3a00eb0b942d23db395c/pa/EZ54447_9d94e668dc322210df3e7532ac086379.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-01-23',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot Partner 1.5 Blue-HDi Cabine Approfondie L2',
'transmission': 'manual',
'trim': 'Cabine Approfondie L2',
'year': 2022}
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ54447%27 HTTP/1.1" 200 None
2026-03-30 11:18:05 [auto1.fr] INFO: Saving data for EZ54447: {'created_time': 1774869485.701236, 'last_price_update_time': 1774869485.701247, 'auction_closing_time': 1774972556.0}
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EZ54447') HTTP/1.1" 204 0
2026-03-30 11:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CX79974/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:07 [auto1.fr] INFO: Channel: 24h | Page: 12 | totalHits: 5567 | hits on page: 40
2026-03-30 11:18:07 [auto1.fr] INFO: Found listing with ID: EH19496
2026-03-30 11:18:07 [auto1.fr] INFO: Found listing with ID: NL70342
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL70342%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.fr] INFO: Scrape type for NL70342: 0
2026-03-30 11:18:07 [auto1.fr] INFO: Found listing with ID: YX07310
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX07310%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.fr] INFO: Scrape type for YX07310: 0
2026-03-30 11:18:07 [auto1.fr] INFO: Found listing with ID: VX76381
2026-03-30 11:18:07 [auto1.fr] INFO: Found listing with ID: PY80925
2026-03-30 11:18:07 [auto1.fr] INFO: Found listing with ID: WW40675
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW40675%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.fr] INFO: Scrape type for WW40675: 2
2026-03-30 11:18:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 113f4eaf-c3ef-59a3-9931-2343f240d043 with identifier: WW40675
2026-03-30 11:18:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 113f4eaf-c3ef-59a3-9931-2343f240d043 with scrape type 2
2026-03-30 11:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 113f4eaf-c3ef-59a3-9931-2343f240d043 with scrape type 2
2026-03-30 11:18:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 113f4eaf-c3ef-59a3-9931-2343f240d043, identifier: WW40675
2026-03-30 11:18:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 113f4eaf-c3ef-59a3-9931-2343f240d043 with identifier: WW40675
2026-03-30 11:18:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 113f4eaf-c3ef-59a3-9931-2343f240d043 with identifier: WW40675
2026-03-30 11:18:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 113f4eaf-c3ef-59a3-9931-2343f240d043 with identifier: WW40675 to the API
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 272,
'expiration_date': '2026-03-31T15:03:02Z',
'fuel_type': 'petrol',
'id': '113f4eaf-c3ef-59a3-9931-2343f240d043',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW40675',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 121996,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-18',
'seller_name': None,
'title': 'Peugeot 308 1.6 THP GTi',
'transmission': 'manual',
'trim': 'GTi',
'year': 2016}
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW40675%27 HTTP/1.1" 200 None
2026-03-30 11:18:08 [auto1.fr] INFO: Saving data for WW40675: {'auction_closing_time': 1774969382.0, 'created_time': 1774264181.377391, 'last_price_update_time': 1774869488.196934}
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WW40675') HTTP/1.1" 204 0
2026-03-30 11:18:08 [auto1.fr] INFO: Found listing with ID: DK33853
2026-03-30 11:18:08 [auto1.fr] INFO: Found listing with ID: UL02558
2026-03-30 11:18:08 [auto1.fr] INFO: Found listing with ID: WB66153
2026-03-30 11:18:08 [auto1.fr] INFO: Found listing with ID: NF20338
2026-03-30 11:18:08 [auto1.fr] INFO: Found listing with ID: NL19951
2026-03-30 11:18:08 [auto1.fr] INFO: Found listing with ID: HY90819
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HY90819%27 HTTP/1.1" 200 None
2026-03-30 11:18:08 [auto1.fr] INFO: Scrape type for HY90819: 1
2026-03-30 11:18:08 [auto1.fr] INFO: Found listing with ID: MB48414
2026-03-30 11:18:08 [auto1.fr] INFO: Found listing with ID: AB78144
2026-03-30 11:18:08 [auto1.fr] INFO: Found listing with ID: RX71466
2026-03-30 11:18:08 [auto1.fr] INFO: Found listing with ID: ZC78269
2026-03-30 11:18:08 [auto1.fr] INFO: Found listing with ID: PE80694
2026-03-30 11:18:08 [auto1.fr] INFO: Found listing with ID: RS22813
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RS22813%27 HTTP/1.1" 200 None
2026-03-30 11:18:08 [auto1.fr] INFO: Scrape type for RS22813: 2
2026-03-30 11:18:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21789a67-9658-55c1-9f8d-9428b29ce1c5 with identifier: RS22813
2026-03-30 11:18:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21789a67-9658-55c1-9f8d-9428b29ce1c5 with scrape type 2
2026-03-30 11:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21789a67-9658-55c1-9f8d-9428b29ce1c5 with scrape type 2
2026-03-30 11:18:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 21789a67-9658-55c1-9f8d-9428b29ce1c5, identifier: RS22813
2026-03-30 11:18:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 21789a67-9658-55c1-9f8d-9428b29ce1c5 with identifier: RS22813
2026-03-30 11:18:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 21789a67-9658-55c1-9f8d-9428b29ce1c5 with identifier: RS22813
2026-03-30 11:18:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 21789a67-9658-55c1-9f8d-9428b29ce1c5 with identifier: RS22813 to the API
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-31T15:45:31Z',
'fuel_type': 'diesel',
'id': '21789a67-9658-55c1-9f8d-9428b29ce1c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS22813',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 158260,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-25',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Sport Platinium',
'transmission': 'automatic',
'trim': 'Sport Platinium',
'year': 2015}
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RS22813%27 HTTP/1.1" 200 None
2026-03-30 11:18:08 [auto1.fr] INFO: Saving data for RS22813: {'auction_closing_time': 1774971931.0, 'created_time': 1773254311.373648, 'last_price_update_time': 1774869488.700995}
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RS22813') HTTP/1.1" 204 0
2026-03-30 11:18:08 [auto1.fr] INFO: Found listing with ID: RK79359
2026-03-30 11:18:08 [auto1.fr] INFO: Found listing with ID: UT77845
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT77845%27 HTTP/1.1" 200 None
2026-03-30 11:18:08 [auto1.fr] INFO: Scrape type for UT77845: 2
2026-03-30 11:18:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91eb2d05-135e-5b8a-8f21-d198dfd77de5 with identifier: UT77845
2026-03-30 11:18:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91eb2d05-135e-5b8a-8f21-d198dfd77de5 with scrape type 2
2026-03-30 11:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91eb2d05-135e-5b8a-8f21-d198dfd77de5 with scrape type 2
2026-03-30 11:18:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 91eb2d05-135e-5b8a-8f21-d198dfd77de5, identifier: UT77845
2026-03-30 11:18:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 91eb2d05-135e-5b8a-8f21-d198dfd77de5 with identifier: UT77845
2026-03-30 11:18:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 91eb2d05-135e-5b8a-8f21-d198dfd77de5 with identifier: UT77845
2026-03-30 11:18:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 91eb2d05-135e-5b8a-8f21-d198dfd77de5 with identifier: UT77845 to the API
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 85,
'expiration_date': '2026-03-31T15:23:48Z',
'fuel_type': 'petrol',
'id': '91eb2d05-135e-5b8a-8f21-d198dfd77de5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT77845',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 162194,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-24',
'seller_name': None,
'title': 'Smart fortwo 1.0 Turbo Basis pulse',
'transmission': 'automatic',
'trim': 'Basis pulse',
'year': 2013}
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT77845%27 HTTP/1.1" 200 None
2026-03-30 11:18:09 [auto1.fr] INFO: Saving data for UT77845: {'auction_closing_time': 1774970628.0, 'created_time': 1773674685.592328, 'last_price_update_time': 1774869489.498586}
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UT77845') HTTP/1.1" 204 0
2026-03-30 11:18:09 [auto1.fr] INFO: Found listing with ID: PK45621
2026-03-30 11:18:09 [auto1.fr] INFO: Found listing with ID: AC65647
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC65647%27 HTTP/1.1" 200 None
2026-03-30 11:18:09 [auto1.fr] INFO: Scrape type for AC65647: 1
2026-03-30 11:18:09 [auto1.fr] INFO: Found listing with ID: RG17064
2026-03-30 11:18:09 [auto1.fr] INFO: Found listing with ID: UA69739
2026-03-30 11:18:09 [auto1.fr] INFO: Found listing with ID: KW43431
2026-03-30 11:18:09 [auto1.fr] INFO: Found listing with ID: KN07283
2026-03-30 11:18:09 [auto1.fr] INFO: Found listing with ID: GT72256
2026-03-30 11:18:09 [auto1.fr] INFO: Found listing with ID: MH50218
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH50218%27 HTTP/1.1" 200 None
2026-03-30 11:18:09 [auto1.fr] INFO: Scrape type for MH50218: 1
2026-03-30 11:18:09 [auto1.fr] INFO: Found listing with ID: YJ92364
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ92364%27 HTTP/1.1" 200 None
2026-03-30 11:18:09 [auto1.fr] INFO: Scrape type for YJ92364: 2
2026-03-30 11:18:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ad4a3ec-e6d6-531c-a269-8a1cbbfaa8c3 with identifier: YJ92364
2026-03-30 11:18:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ad4a3ec-e6d6-531c-a269-8a1cbbfaa8c3 with scrape type 2
2026-03-30 11:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ad4a3ec-e6d6-531c-a269-8a1cbbfaa8c3 with scrape type 2
2026-03-30 11:18:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3ad4a3ec-e6d6-531c-a269-8a1cbbfaa8c3, identifier: YJ92364
2026-03-30 11:18:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3ad4a3ec-e6d6-531c-a269-8a1cbbfaa8c3 with identifier: YJ92364
2026-03-30 11:18:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3ad4a3ec-e6d6-531c-a269-8a1cbbfaa8c3 with identifier: YJ92364
2026-03-30 11:18:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3ad4a3ec-e6d6-531c-a269-8a1cbbfaa8c3 with identifier: YJ92364 to the API
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:07:09Z',
'fuel_type': 'diesel',
'id': '3ad4a3ec-e6d6-531c-a269-8a1cbbfaa8c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ92364',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 145260,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-06',
'seller_name': None,
'title': 'Dacia Duster 1.5 Blue dCi Essential 4x4',
'transmission': 'manual',
'trim': 'Essential 4x4',
'year': 2019}
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ92364%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.fr] INFO: Saving data for YJ92364: {'auction_closing_time': 1774969629.0, 'created_time': 1772735074.739946, 'last_price_update_time': 1774869490.183578}
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YJ92364') HTTP/1.1" 204 0
2026-03-30 11:18:10 [auto1.fr] INFO: Found listing with ID: EY29396
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY29396%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.fr] INFO: Scrape type for EY29396: 1
2026-03-30 11:18:10 [auto1.fr] INFO: Found listing with ID: VN71895
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN71895%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.fr] INFO: Scrape type for VN71895: 2
2026-03-30 11:18:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15a77c86-7678-5ce8-a80e-bb1c115a43c8 with identifier: VN71895
2026-03-30 11:18:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15a77c86-7678-5ce8-a80e-bb1c115a43c8 with scrape type 2
2026-03-30 11:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15a77c86-7678-5ce8-a80e-bb1c115a43c8 with scrape type 2
2026-03-30 11:18:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 15a77c86-7678-5ce8-a80e-bb1c115a43c8, identifier: VN71895
2026-03-30 11:18:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 15a77c86-7678-5ce8-a80e-bb1c115a43c8 with identifier: VN71895
2026-03-30 11:18:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 15a77c86-7678-5ce8-a80e-bb1c115a43c8 with identifier: VN71895
2026-03-30 11:18:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 15a77c86-7678-5ce8-a80e-bb1c115a43c8 with identifier: VN71895 to the API
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:48:28Z',
'fuel_type': 'petrol',
'id': '15a77c86-7678-5ce8-a80e-bb1c115a43c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN71895',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 182241,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-01-03',
'seller_name': None,
'title': 'Renault Twingo 1.2 Privilege',
'transmission': 'manual',
'trim': 'Privilege',
'year': 2002}
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN71895%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.fr] INFO: Saving data for VN71895: {'auction_closing_time': 1774972108.0, 'created_time': 1774278714.03631, 'last_price_update_time': 1774869490.750494}
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VN71895') HTTP/1.1" 204 0
2026-03-30 11:18:10 [auto1.fr] INFO: Found listing with ID: FX07138
2026-03-30 11:18:10 [auto1.fr] INFO: Found listing with ID: HW58466
2026-03-30 11:18:10 [auto1.fr] INFO: Found listing with ID: MD91591
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD91591%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.fr] INFO: Scrape type for MD91591: 1
2026-03-30 11:18:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HN32336> (referer: https://www.auto1.com/v1/car-details-view/HN32336/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:10 [auto1.fr] INFO: Found listing with ID: XA31897
2026-03-30 11:18:10 [auto1.fr] INFO: Found listing with ID: XL96735
2026-03-30 11:18:10 [auto1.fr] INFO: Found listing with ID: FG22650
2026-03-30 11:18:10 [auto1.fr] INFO: Found listing with ID: JA21075
2026-03-30 11:18:10 [auto1.fr] INFO: Found listing with ID: JV74591
2026-03-30 11:18:10 [auto1.fr] INFO: Found listing with ID: SD17416
2026-03-30 11:18:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3086e194-61ea-5d5e-92ec-e245b2611ef4 with identifier: HN32336
2026-03-30 11:18:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3086e194-61ea-5d5e-92ec-e245b2611ef4 with scrape type 1
2026-03-30 11:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3086e194-61ea-5d5e-92ec-e245b2611ef4
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fe0%252F30e0a91711903222d414b488ff879311%252Fpa%252FHN32336_713325ff3f5f2ab9991cda0f2f0c6ccf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_713325ff3f5f2ab9991cda0f2f0c6ccf.jpg not downloaded yet
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fe0%252F30e0a91711903222d414b488ff879311%252Fpa%252FHN32336_c1cc153890615bae949eff207abcf6f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_c1cc153890615bae949eff207abcf6f0.jpg not downloaded yet
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fe0%252F30e0a91711903222d414b488ff879311%252Fpa%252FHN32336_055adae3f96a78d61e82bb60194ef08e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_055adae3f96a78d61e82bb60194ef08e.jpg not downloaded yet
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fe0%252F30e0a91711903222d414b488ff879311%252Fpa%252FHN32336_4d7e8de0e3d57275eaa83aa0e6d225e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_4d7e8de0e3d57275eaa83aa0e6d225e4.jpg not downloaded yet
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fe0%252F30e0a91711903222d414b488ff879311%252Fpa%252FHN32336_f9fc6fd47dd8a9167ef23a66a71245e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_f9fc6fd47dd8a9167ef23a66a71245e5.jpg not downloaded yet
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fe0%252F30e0a91711903222d414b488ff879311%252Fpa%252FHN32336_b11ef1999e461dae99d78ff4175ec973.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_b11ef1999e461dae99d78ff4175ec973.jpg not downloaded yet
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fe0%252F30e0a91711903222d414b488ff879311%252Fpa%252FHN32336_954f7c3922bf4d160f8cf5a8a2344f24.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_954f7c3922bf4d160f8cf5a8a2344f24.jpg not downloaded yet
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fe0%252F30e0a91711903222d414b488ff879311%252Fpa%252FHN32336_a32382a8f93bd1ee89b04a1740b1fbbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_a32382a8f93bd1ee89b04a1740b1fbbd.jpg not downloaded yet
2026-03-30 11:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_713325ff3f5f2ab9991cda0f2f0c6ccf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fe0%252F30e0a91711903222d414b488ff879311%252Fpa%252FHN32336_a21429fa372a70070c8c768295a04a7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_a21429fa372a70070c8c768295a04a7e.jpg not downloaded yet
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fe0%252F30e0a91711903222d414b488ff879311%252Fpa%252FHN32336_7a7cdf0e77eeb244938e3cd6f9cd6e7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_7a7cdf0e77eeb244938e3cd6f9cd6e7b.jpg not downloaded yet
2026-03-30 11:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_c1cc153890615bae949eff207abcf6f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738689990>
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3086e194-61ea-5d5e-92ec-e245b2611ef4/3086e194-61ea-5d5e-92ec-e245b2611ef4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fe0%252F30e0a91711903222d414b488ff879311%252Fpa%252FHN32336_713325ff3f5f2ab9991cda0f2f0c6ccf.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_713325ff3f5f2ab9991cda0f2f0c6ccf.jpg saved to cache
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3086e194-61ea-5d5e-92ec-e245b2611ef4
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384c08d0>
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3086e194-61ea-5d5e-92ec-e245b2611ef4/3086e194-61ea-5d5e-92ec-e245b2611ef4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fe0%252F30e0a91711903222d414b488ff879311%252Fpa%252FHN32336_c1cc153890615bae949eff207abcf6f0.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_c1cc153890615bae949eff207abcf6f0.jpg saved to cache
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3086e194-61ea-5d5e-92ec-e245b2611ef4
2026-03-30 11:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_a32382a8f93bd1ee89b04a1740b1fbbd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_7a7cdf0e77eeb244938e3cd6f9cd6e7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_954f7c3922bf4d160f8cf5a8a2344f24.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073867c2d0>
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3086e194-61ea-5d5e-92ec-e245b2611ef4/3086e194-61ea-5d5e-92ec-e245b2611ef4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fe0%252F30e0a91711903222d414b488ff879311%252Fpa%252FHN32336_a32382a8f93bd1ee89b04a1740b1fbbd.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_a32382a8f93bd1ee89b04a1740b1fbbd.jpg saved to cache
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3086e194-61ea-5d5e-92ec-e245b2611ef4
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383e8050>
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3086e194-61ea-5d5e-92ec-e245b2611ef4/3086e194-61ea-5d5e-92ec-e245b2611ef4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fe0%252F30e0a91711903222d414b488ff879311%252Fpa%252FHN32336_7a7cdf0e77eeb244938e3cd6f9cd6e7b.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_7a7cdf0e77eeb244938e3cd6f9cd6e7b.jpg saved to cache
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3086e194-61ea-5d5e-92ec-e245b2611ef4
2026-03-30 11:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_a21429fa372a70070c8c768295a04a7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384e92d0>
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3086e194-61ea-5d5e-92ec-e245b2611ef4/3086e194-61ea-5d5e-92ec-e245b2611ef4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fe0%252F30e0a91711903222d414b488ff879311%252Fpa%252FHN32336_954f7c3922bf4d160f8cf5a8a2344f24.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_954f7c3922bf4d160f8cf5a8a2344f24.jpg saved to cache
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3086e194-61ea-5d5e-92ec-e245b2611ef4
2026-03-30 11:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_b11ef1999e461dae99d78ff4175ec973.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738686010>
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3086e194-61ea-5d5e-92ec-e245b2611ef4/3086e194-61ea-5d5e-92ec-e245b2611ef4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fe0%252F30e0a91711903222d414b488ff879311%252Fpa%252FHN32336_a21429fa372a70070c8c768295a04a7e.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_a21429fa372a70070c8c768295a04a7e.jpg saved to cache
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3086e194-61ea-5d5e-92ec-e245b2611ef4
2026-03-30 11:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_4d7e8de0e3d57275eaa83aa0e6d225e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_055adae3f96a78d61e82bb60194ef08e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384c3710>
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3086e194-61ea-5d5e-92ec-e245b2611ef4/3086e194-61ea-5d5e-92ec-e245b2611ef4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fe0%252F30e0a91711903222d414b488ff879311%252Fpa%252FHN32336_b11ef1999e461dae99d78ff4175ec973.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_b11ef1999e461dae99d78ff4175ec973.jpg saved to cache
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3086e194-61ea-5d5e-92ec-e245b2611ef4
2026-03-30 11:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_f9fc6fd47dd8a9167ef23a66a71245e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384eb5d0>
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3086e194-61ea-5d5e-92ec-e245b2611ef4/3086e194-61ea-5d5e-92ec-e245b2611ef4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fe0%252F30e0a91711903222d414b488ff879311%252Fpa%252FHN32336_4d7e8de0e3d57275eaa83aa0e6d225e4.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_4d7e8de0e3d57275eaa83aa0e6d225e4.jpg saved to cache
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3086e194-61ea-5d5e-92ec-e245b2611ef4
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384ebc10>
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3086e194-61ea-5d5e-92ec-e245b2611ef4/3086e194-61ea-5d5e-92ec-e245b2611ef4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fe0%252F30e0a91711903222d414b488ff879311%252Fpa%252FHN32336_055adae3f96a78d61e82bb60194ef08e.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_055adae3f96a78d61e82bb60194ef08e.jpg saved to cache
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3086e194-61ea-5d5e-92ec-e245b2611ef4
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383f1e90>
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3086e194-61ea-5d5e-92ec-e245b2611ef4/3086e194-61ea-5d5e-92ec-e245b2611ef4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fe0%252F30e0a91711903222d414b488ff879311%252Fpa%252FHN32336_f9fc6fd47dd8a9167ef23a66a71245e5.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_f9fc6fd47dd8a9167ef23a66a71245e5.jpg saved to cache
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3086e194-61ea-5d5e-92ec-e245b2611ef4
2026-03-30 11:18:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3086e194-61ea-5d5e-92ec-e245b2611ef4, skipping ID generation
2026-03-30 11:18:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3086e194-61ea-5d5e-92ec-e245b2611ef4 with scrape type 1
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3086e194-61ea-5d5e-92ec-e245b2611ef4 sending to next pipeline
2026-03-30 11:18:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3086e194-61ea-5d5e-92ec-e245b2611ef4, identifier: HN32336
2026-03-30 11:18:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3086e194-61ea-5d5e-92ec-e245b2611ef4 with identifier: HN32336
2026-03-30 11:18:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3086e194-61ea-5d5e-92ec-e245b2611ef4 with identifier: HN32336
2026-03-30 11:18:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3086e194-61ea-5d5e-92ec-e245b2611ef4 with identifier: HN32336 to the API
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_f9fc6fd47dd8a9167ef23a66a71245e5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:27:35Z',
'fuel_type': 'petrol',
'id': '3086e194-61ea-5d5e-92ec-e245b2611ef4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN32336',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Citroen',
'model': 'C3',
'odometer': 62846,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3086e194-61ea-5d5e-92ec-e245b2611ef4/3086e194-61ea-5d5e-92ec-e245b2611ef4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_713325ff3f5f2ab9991cda0f2f0c6ccf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3086e194-61ea-5d5e-92ec-e245b2611ef4/3086e194-61ea-5d5e-92ec-e245b2611ef4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53247,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_c1cc153890615bae949eff207abcf6f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3086e194-61ea-5d5e-92ec-e245b2611ef4/3086e194-61ea-5d5e-92ec-e245b2611ef4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92230,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_055adae3f96a78d61e82bb60194ef08e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3086e194-61ea-5d5e-92ec-e245b2611ef4/3086e194-61ea-5d5e-92ec-e245b2611ef4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35021,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_4d7e8de0e3d57275eaa83aa0e6d225e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3086e194-61ea-5d5e-92ec-e245b2611ef4/3086e194-61ea-5d5e-92ec-e245b2611ef4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41616,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_f9fc6fd47dd8a9167ef23a66a71245e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3086e194-61ea-5d5e-92ec-e245b2611ef4/3086e194-61ea-5d5e-92ec-e245b2611ef4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_b11ef1999e461dae99d78ff4175ec973.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3086e194-61ea-5d5e-92ec-e245b2611ef4/3086e194-61ea-5d5e-92ec-e245b2611ef4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44922,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_954f7c3922bf4d160f8cf5a8a2344f24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3086e194-61ea-5d5e-92ec-e245b2611ef4/3086e194-61ea-5d5e-92ec-e245b2611ef4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104404,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_a32382a8f93bd1ee89b04a1740b1fbbd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3086e194-61ea-5d5e-92ec-e245b2611ef4/3086e194-61ea-5d5e-92ec-e245b2611ef4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49506,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_a21429fa372a70070c8c768295a04a7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3086e194-61ea-5d5e-92ec-e245b2611ef4/3086e194-61ea-5d5e-92ec-e245b2611ef4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54617,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/e0/30e0a91711903222d414b488ff879311/pa/HN32336_7a7cdf0e77eeb244938e3cd6f9cd6e7b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-14',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2018}
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN32336%27 HTTP/1.1" 200 None
2026-03-30 11:18:12 [auto1.fr] INFO: Saving data for HN32336: {'created_time': 1774869492.337543, 'last_price_update_time': 1774869492.337554, 'auction_closing_time': 1774970855.0}
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HN32336') HTTP/1.1" 204 0
2026-03-30 11:18:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CX79974> (referer: https://www.auto1.com/v1/car-details-view/CX79974/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29ec11b3-0035-5c36-811d-5339faee57da with identifier: CX79974
2026-03-30 11:18:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29ec11b3-0035-5c36-811d-5339faee57da with scrape type 1
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 29ec11b3-0035-5c36-811d-5339faee57da
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F53%252F19538dd9b96cd0ad2dd6585c2100f49c%252Fpa%252FCX79974_9860c94ccd99dea51f00d0c7798fee96.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_9860c94ccd99dea51f00d0c7798fee96.jpg already downloaded
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F53%252F19538dd9b96cd0ad2dd6585c2100f49c%252Fpa%252FCX79974_0209faa49d7f8c68b283f19ce4417fe6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_0209faa49d7f8c68b283f19ce4417fe6.jpg already downloaded
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F53%252F19538dd9b96cd0ad2dd6585c2100f49c%252Fpa%252FCX79974_c0ea84b2c0beeefe3eaf48f7f64c9e64.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_c0ea84b2c0beeefe3eaf48f7f64c9e64.jpg already downloaded
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F53%252F19538dd9b96cd0ad2dd6585c2100f49c%252Fpa%252FCX79974_2f4dc479dba1fd0eb533cfb66defa6be.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_2f4dc479dba1fd0eb533cfb66defa6be.jpg already downloaded
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F53%252F19538dd9b96cd0ad2dd6585c2100f49c%252Fpa%252FCX79974_eb2018df0b1777a04495d64407a31af1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_eb2018df0b1777a04495d64407a31af1.jpg already downloaded
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F53%252F19538dd9b96cd0ad2dd6585c2100f49c%252Fpa%252FCX79974_dd03b66ef10f49fcd3291ea8308cd44a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_dd03b66ef10f49fcd3291ea8308cd44a.jpg already downloaded
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F53%252F19538dd9b96cd0ad2dd6585c2100f49c%252Fpa%252FCX79974_ff0384b37a91983e660603ae0f744dfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_ff0384b37a91983e660603ae0f744dfc.jpg already downloaded
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F53%252F19538dd9b96cd0ad2dd6585c2100f49c%252Fpa%252FCX79974_cfac6d0c44eba1ff604c48ae45926c0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_cfac6d0c44eba1ff604c48ae45926c0e.jpg already downloaded
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F53%252F19538dd9b96cd0ad2dd6585c2100f49c%252Fpa%252FCX79974_8670ca884f0309078c1abc21e61e4517.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_8670ca884f0309078c1abc21e61e4517.jpg already downloaded
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F53%252F19538dd9b96cd0ad2dd6585c2100f49c%252Fpa%252FCX79974_6fe332c633d54e7ee4f8fe7b79281255.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_6fe332c633d54e7ee4f8fe7b79281255.jpg already downloaded
2026-03-30 11:18:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 29ec11b3-0035-5c36-811d-5339faee57da, identifier: CX79974
2026-03-30 11:18:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 29ec11b3-0035-5c36-811d-5339faee57da with identifier: CX79974
2026-03-30 11:18:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 29ec11b3-0035-5c36-811d-5339faee57da with identifier: CX79974
2026-03-30 11:18:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 29ec11b3-0035-5c36-811d-5339faee57da with identifier: CX79974 to the API
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CX79974>
{'auction_title': '',
'c_o_2_emission_value': 170,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:02:27Z',
'fuel_type': 'diesel',
'id': '29ec11b3-0035-5c36-811d-5339faee57da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX79974',
'listing': 'auction',
'location': 'FR, Houecourt',
'make': 'Renault',
'model': 'Trafic',
'odometer': 113421,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_9860c94ccd99dea51f00d0c7798fee96.jpg',
'https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_0209faa49d7f8c68b283f19ce4417fe6.jpg',
'https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_c0ea84b2c0beeefe3eaf48f7f64c9e64.jpg',
'https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_2f4dc479dba1fd0eb533cfb66defa6be.jpg',
'https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_eb2018df0b1777a04495d64407a31af1.jpg',
'https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_dd03b66ef10f49fcd3291ea8308cd44a.jpg',
'https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_ff0384b37a91983e660603ae0f744dfc.jpg',
'https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_cfac6d0c44eba1ff604c48ae45926c0e.jpg',
'https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_8670ca884f0309078c1abc21e61e4517.jpg',
'https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_6fe332c633d54e7ee4f8fe7b79281255.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29ec11b3-0035-5c36-811d-5339faee57da/29ec11b3-0035-5c36-811d-5339faee57da_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_9860c94ccd99dea51f00d0c7798fee96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29ec11b3-0035-5c36-811d-5339faee57da/29ec11b3-0035-5c36-811d-5339faee57da_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60012,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_0209faa49d7f8c68b283f19ce4417fe6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29ec11b3-0035-5c36-811d-5339faee57da/29ec11b3-0035-5c36-811d-5339faee57da_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_c0ea84b2c0beeefe3eaf48f7f64c9e64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29ec11b3-0035-5c36-811d-5339faee57da/29ec11b3-0035-5c36-811d-5339faee57da_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_2f4dc479dba1fd0eb533cfb66defa6be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29ec11b3-0035-5c36-811d-5339faee57da/29ec11b3-0035-5c36-811d-5339faee57da_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54040,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_eb2018df0b1777a04495d64407a31af1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29ec11b3-0035-5c36-811d-5339faee57da/29ec11b3-0035-5c36-811d-5339faee57da_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47427,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_dd03b66ef10f49fcd3291ea8308cd44a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29ec11b3-0035-5c36-811d-5339faee57da/29ec11b3-0035-5c36-811d-5339faee57da_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_ff0384b37a91983e660603ae0f744dfc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29ec11b3-0035-5c36-811d-5339faee57da/29ec11b3-0035-5c36-811d-5339faee57da_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64050,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_cfac6d0c44eba1ff604c48ae45926c0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29ec11b3-0035-5c36-811d-5339faee57da/29ec11b3-0035-5c36-811d-5339faee57da_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72897,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_8670ca884f0309078c1abc21e61e4517.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29ec11b3-0035-5c36-811d-5339faee57da/29ec11b3-0035-5c36-811d-5339faee57da_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71651,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/53/19538dd9b96cd0ad2dd6585c2100f49c/pa/CX79974_6fe332c633d54e7ee4f8fe7b79281255.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-08-07',
'seats_number': 3,
'seller_name': None,
'title': 'Renault Trafic 1.6 dCi Grand Confort L1H1 1000',
'transmission': 'manual',
'trim': 'Grand Confort L1H1 1000',
'year': 2018}
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX79974%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [auto1.fr] INFO: Saving data for CX79974: {'created_time': 1774869493.991227, 'last_price_update_time': 1774869493.991242, 'auction_closing_time': 1774969347.0}
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CX79974') HTTP/1.1" 204 0
2026-03-30 11:18:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:17 [auto1.fr] INFO: Channel: 24h | Page: 13 | totalHits: 5567 | hits on page: 40
2026-03-30 11:18:17 [auto1.fr] INFO: Found listing with ID: CZ33179
2026-03-30 11:18:17 [auto1.fr] INFO: Found listing with ID: XB50119
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB50119%27 HTTP/1.1" 200 None
2026-03-30 11:18:17 [auto1.fr] INFO: Scrape type for XB50119: 1
2026-03-30 11:18:17 [auto1.fr] INFO: Found listing with ID: WU92358
2026-03-30 11:18:17 [auto1.fr] INFO: Found listing with ID: BD23693
2026-03-30 11:18:17 [auto1.fr] INFO: Found listing with ID: PH25199
2026-03-30 11:18:17 [auto1.fr] INFO: Found listing with ID: JJ00045
2026-03-30 11:18:17 [auto1.fr] INFO: Found listing with ID: GH15305
2026-03-30 11:18:17 [auto1.fr] INFO: Found listing with ID: ZV76946
2026-03-30 11:18:17 [auto1.fr] INFO: Found listing with ID: PY79941
2026-03-30 11:18:17 [auto1.fr] INFO: Found listing with ID: KH65686
2026-03-30 11:18:17 [auto1.fr] INFO: Found listing with ID: FG40566
2026-03-30 11:18:17 [auto1.fr] INFO: Found listing with ID: MC27609
2026-03-30 11:18:17 [auto1.fr] INFO: Found listing with ID: WP31416
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP31416%27 HTTP/1.1" 200 None
2026-03-30 11:18:17 [auto1.fr] INFO: Scrape type for WP31416: 2
2026-03-30 11:18:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93b28a3b-99c0-5769-a04f-3283f1a40af4 with identifier: WP31416
2026-03-30 11:18:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93b28a3b-99c0-5769-a04f-3283f1a40af4 with scrape type 2
2026-03-30 11:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93b28a3b-99c0-5769-a04f-3283f1a40af4 with scrape type 2
2026-03-30 11:18:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 93b28a3b-99c0-5769-a04f-3283f1a40af4, identifier: WP31416
2026-03-30 11:18:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 93b28a3b-99c0-5769-a04f-3283f1a40af4 with identifier: WP31416
2026-03-30 11:18:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 93b28a3b-99c0-5769-a04f-3283f1a40af4 with identifier: WP31416
2026-03-30 11:18:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 93b28a3b-99c0-5769-a04f-3283f1a40af4 with identifier: WP31416 to the API
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-31T15:19:28Z',
'fuel_type': 'diesel',
'id': '93b28a3b-99c0-5769-a04f-3283f1a40af4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP31416',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 181598,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-04',
'seller_name': None,
'title': 'Toyota RAV 4 2.0 D-4D Dynamic',
'transmission': 'manual',
'trim': 'Dynamic',
'year': 2017}
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP31416%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.fr] INFO: Saving data for WP31416: {'auction_closing_time': 1774970368.0, 'created_time': 1773120057.31622, 'last_price_update_time': 1774869498.210455}
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WP31416') HTTP/1.1" 204 0
2026-03-30 11:18:18 [auto1.fr] INFO: Found listing with ID: YH69982
2026-03-30 11:18:18 [auto1.fr] INFO: Found listing with ID: YN92407
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YN92407%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.fr] INFO: Scrape type for YN92407: 2
2026-03-30 11:18:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2610603-ab4e-5ffe-b0f0-47a8375c9af1 with identifier: YN92407
2026-03-30 11:18:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2610603-ab4e-5ffe-b0f0-47a8375c9af1 with scrape type 2
2026-03-30 11:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2610603-ab4e-5ffe-b0f0-47a8375c9af1 with scrape type 2
2026-03-30 11:18:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b2610603-ab4e-5ffe-b0f0-47a8375c9af1, identifier: YN92407
2026-03-30 11:18:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b2610603-ab4e-5ffe-b0f0-47a8375c9af1 with identifier: YN92407
2026-03-30 11:18:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b2610603-ab4e-5ffe-b0f0-47a8375c9af1 with identifier: YN92407
2026-03-30 11:18:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b2610603-ab4e-5ffe-b0f0-47a8375c9af1 with identifier: YN92407 to the API
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:46:34Z',
'fuel_type': 'petrol',
'id': 'b2610603-ab4e-5ffe-b0f0-47a8375c9af1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN92407',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 106029,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-26',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2020}
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YN92407%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.fr] INFO: Saving data for YN92407: {'auction_closing_time': 1774971994.0, 'created_time': 1774278987.375817, 'last_price_update_time': 1774869498.759592}
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YN92407') HTTP/1.1" 204 0
2026-03-30 11:18:18 [auto1.fr] INFO: Found listing with ID: GC01240
2026-03-30 11:18:18 [auto1.fr] INFO: Found listing with ID: VF41194
2026-03-30 11:18:18 [auto1.fr] INFO: Found listing with ID: DB59930
2026-03-30 11:18:18 [auto1.fr] INFO: Found listing with ID: AB15378
2026-03-30 11:18:18 [auto1.fr] INFO: Found listing with ID: VV69981
2026-03-30 11:18:18 [auto1.fr] INFO: Found listing with ID: TK36036
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK36036%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.fr] INFO: Scrape type for TK36036: 2
2026-03-30 11:18:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c920c7b-2136-5eb4-826e-07df64691dd9 with identifier: TK36036
2026-03-30 11:18:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c920c7b-2136-5eb4-826e-07df64691dd9 with scrape type 2
2026-03-30 11:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c920c7b-2136-5eb4-826e-07df64691dd9 with scrape type 2
2026-03-30 11:18:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3c920c7b-2136-5eb4-826e-07df64691dd9, identifier: TK36036
2026-03-30 11:18:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3c920c7b-2136-5eb4-826e-07df64691dd9 with identifier: TK36036
2026-03-30 11:18:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3c920c7b-2136-5eb4-826e-07df64691dd9 with identifier: TK36036
2026-03-30 11:18:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3c920c7b-2136-5eb4-826e-07df64691dd9 with identifier: TK36036 to the API
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:41:14Z',
'fuel_type': 'diesel',
'id': '3c920c7b-2136-5eb4-826e-07df64691dd9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK36036',
'listing': 'auction',
'make': 'Renault',
'model': 'Koleos',
'odometer': 149631,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-22',
'seller_name': None,
'title': 'Renault Koleos 1.6 dCi Energy Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2018}
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK36036%27 HTTP/1.1" 200 None
2026-03-30 11:18:19 [auto1.fr] INFO: Saving data for TK36036: {'auction_closing_time': 1774971674.0, 'created_time': 1773252795.981922, 'last_price_update_time': 1774869499.278467}
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TK36036') HTTP/1.1" 204 0
2026-03-30 11:18:19 [auto1.fr] INFO: Found listing with ID: BM86570
2026-03-30 11:18:19 [auto1.fr] INFO: Found listing with ID: BX30408
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX30408%27 HTTP/1.1" 200 None
2026-03-30 11:18:19 [auto1.fr] INFO: Scrape type for BX30408: 2
2026-03-30 11:18:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b8e330e-8ddd-556e-94bf-297cf4f4aed7 with identifier: BX30408
2026-03-30 11:18:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b8e330e-8ddd-556e-94bf-297cf4f4aed7 with scrape type 2
2026-03-30 11:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b8e330e-8ddd-556e-94bf-297cf4f4aed7 with scrape type 2
2026-03-30 11:18:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1b8e330e-8ddd-556e-94bf-297cf4f4aed7, identifier: BX30408
2026-03-30 11:18:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1b8e330e-8ddd-556e-94bf-297cf4f4aed7 with identifier: BX30408
2026-03-30 11:18:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1b8e330e-8ddd-556e-94bf-297cf4f4aed7 with identifier: BX30408
2026-03-30 11:18:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1b8e330e-8ddd-556e-94bf-297cf4f4aed7 with identifier: BX30408 to the API
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:53:16Z',
'fuel_type': 'petrol',
'id': '1b8e330e-8ddd-556e-94bf-297cf4f4aed7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX30408',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Bayon',
'odometer': 27083,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-01',
'seller_name': None,
'title': 'Hyundai Bayon 1.0 T-GDI Mild-Hybrid Intuitive 2WD',
'transmission': 'automatic',
'trim': 'Intuitive 2WD',
'year': 2024}
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX30408%27 HTTP/1.1" 200 None
2026-03-30 11:18:19 [auto1.fr] INFO: Saving data for BX30408: {'auction_closing_time': 1774972396.0, 'created_time': 1774264615.362922, 'last_price_update_time': 1774869499.782957}
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BX30408') HTTP/1.1" 204 0
2026-03-30 11:18:19 [auto1.fr] INFO: Found listing with ID: FR75409
2026-03-30 11:18:19 [auto1.fr] INFO: Found listing with ID: EJ56580
2026-03-30 11:18:19 [auto1.fr] INFO: Found listing with ID: YJ70488
2026-03-30 11:18:19 [auto1.fr] INFO: Found listing with ID: SS19249
2026-03-30 11:18:19 [auto1.fr] INFO: Found listing with ID: ST02025
2026-03-30 11:18:19 [auto1.fr] INFO: Found listing with ID: PS25944
2026-03-30 11:18:19 [auto1.fr] INFO: Found listing with ID: RX64079
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX64079%27 HTTP/1.1" 200 None
2026-03-30 11:18:19 [auto1.fr] INFO: Scrape type for RX64079: 1
2026-03-30 11:18:19 [auto1.fr] INFO: Found listing with ID: PT96039
2026-03-30 11:18:19 [auto1.fr] INFO: Found listing with ID: MG58458
2026-03-30 11:18:19 [auto1.fr] INFO: Found listing with ID: JG14972
2026-03-30 11:18:19 [auto1.fr] INFO: Found listing with ID: WB68155
2026-03-30 11:18:19 [auto1.fr] INFO: Found listing with ID: AX54768
2026-03-30 11:18:19 [auto1.fr] INFO: Found listing with ID: VT05411
2026-03-30 11:18:19 [auto1.fr] INFO: Found listing with ID: YV32502
2026-03-30 11:18:19 [auto1.fr] INFO: Found listing with ID: JA45555
2026-03-30 11:18:19 [auto1.fr] INFO: Found listing with ID: FY62373
2026-03-30 11:18:19 [auto1.fr] INFO: Found listing with ID: GE73125
2026-03-30 11:18:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HY90819/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WD02529> (referer: https://www.auto1.com/v1/car-details-view/WD02529/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6565a3b9-3310-58f2-ada2-265678700013 with identifier: WD02529
2026-03-30 11:18:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6565a3b9-3310-58f2-ada2-265678700013 with scrape type 1
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6565a3b9-3310-58f2-ada2-265678700013
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1e%252Fae1e120669e7d88876433a85589d6585%252Fpa%252FWD02529_5ebbad46f508de1981b5ff360de57ce0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_5ebbad46f508de1981b5ff360de57ce0.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1e%252Fae1e120669e7d88876433a85589d6585%252Fpa%252FWD02529_0b3c3724d66b8a5210649ff62a5ea0ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_0b3c3724d66b8a5210649ff62a5ea0ca.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1e%252Fae1e120669e7d88876433a85589d6585%252Fpa%252FWD02529_98879e0fb223bb755fc59e6d91d717b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_98879e0fb223bb755fc59e6d91d717b4.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1e%252Fae1e120669e7d88876433a85589d6585%252Fpa%252FWD02529_efdaa5a5b114cb950287ab765e222594.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_efdaa5a5b114cb950287ab765e222594.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1e%252Fae1e120669e7d88876433a85589d6585%252Fpa%252FWD02529_5d433ca8c6b2ddeb7f03f032f020029a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_5d433ca8c6b2ddeb7f03f032f020029a.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1e%252Fae1e120669e7d88876433a85589d6585%252Fpa%252FWD02529_6e1963b1b18346b7e47777f09bb55670.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_6e1963b1b18346b7e47777f09bb55670.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1e%252Fae1e120669e7d88876433a85589d6585%252Fpa%252FWD02529_1d64169950c990256021cc41147b4d28.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_1d64169950c990256021cc41147b4d28.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1e%252Fae1e120669e7d88876433a85589d6585%252Fpa%252FWD02529_75fe93264ba120da0969f5add9f27b0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_75fe93264ba120da0969f5add9f27b0a.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1e%252Fae1e120669e7d88876433a85589d6585%252Fpa%252FWD02529_74d3964e48651b242ab1656c8cbd96bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_74d3964e48651b242ab1656c8cbd96bd.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1e%252Fae1e120669e7d88876433a85589d6585%252Fpa%252FWD02529_e4fb3171e66ff1921a8ddc3dd2b183f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_e4fb3171e66ff1921a8ddc3dd2b183f6.jpg already downloaded
2026-03-30 11:18:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6565a3b9-3310-58f2-ada2-265678700013, identifier: WD02529
2026-03-30 11:18:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6565a3b9-3310-58f2-ada2-265678700013 with identifier: WD02529
2026-03-30 11:18:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6565a3b9-3310-58f2-ada2-265678700013 with identifier: WD02529
2026-03-30 11:18:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6565a3b9-3310-58f2-ada2-265678700013 with identifier: WD02529 to the API
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WD02529>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:59:45Z',
'fuel_type': 'diesel',
'id': '6565a3b9-3310-58f2-ada2-265678700013',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD02529',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Peugeot',
'model': '5008',
'odometer': 118310,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_5ebbad46f508de1981b5ff360de57ce0.jpg',
'https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_0b3c3724d66b8a5210649ff62a5ea0ca.jpg',
'https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_98879e0fb223bb755fc59e6d91d717b4.jpg',
'https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_efdaa5a5b114cb950287ab765e222594.jpg',
'https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_5d433ca8c6b2ddeb7f03f032f020029a.jpg',
'https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_6e1963b1b18346b7e47777f09bb55670.jpg',
'https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_1d64169950c990256021cc41147b4d28.jpg',
'https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_75fe93264ba120da0969f5add9f27b0a.jpg',
'https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_74d3964e48651b242ab1656c8cbd96bd.jpg',
'https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_e4fb3171e66ff1921a8ddc3dd2b183f6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6565a3b9-3310-58f2-ada2-265678700013/6565a3b9-3310-58f2-ada2-265678700013_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_5ebbad46f508de1981b5ff360de57ce0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6565a3b9-3310-58f2-ada2-265678700013/6565a3b9-3310-58f2-ada2-265678700013_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59696,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_0b3c3724d66b8a5210649ff62a5ea0ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6565a3b9-3310-58f2-ada2-265678700013/6565a3b9-3310-58f2-ada2-265678700013_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_98879e0fb223bb755fc59e6d91d717b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6565a3b9-3310-58f2-ada2-265678700013/6565a3b9-3310-58f2-ada2-265678700013_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_efdaa5a5b114cb950287ab765e222594.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6565a3b9-3310-58f2-ada2-265678700013/6565a3b9-3310-58f2-ada2-265678700013_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75088,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_5d433ca8c6b2ddeb7f03f032f020029a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6565a3b9-3310-58f2-ada2-265678700013/6565a3b9-3310-58f2-ada2-265678700013_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64535,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_6e1963b1b18346b7e47777f09bb55670.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6565a3b9-3310-58f2-ada2-265678700013/6565a3b9-3310-58f2-ada2-265678700013_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62339,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_1d64169950c990256021cc41147b4d28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6565a3b9-3310-58f2-ada2-265678700013/6565a3b9-3310-58f2-ada2-265678700013_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56014,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_75fe93264ba120da0969f5add9f27b0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6565a3b9-3310-58f2-ada2-265678700013/6565a3b9-3310-58f2-ada2-265678700013_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56348,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_74d3964e48651b242ab1656c8cbd96bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6565a3b9-3310-58f2-ada2-265678700013/6565a3b9-3310-58f2-ada2-265678700013_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76055,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/1e/ae1e120669e7d88876433a85589d6585/pa/WD02529_e4fb3171e66ff1921a8ddc3dd2b183f6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-11-03',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 1.6 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2015}
2026-03-30 11:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD02529%27 HTTP/1.1" 200 None
2026-03-30 11:18:24 [auto1.fr] INFO: Saving data for WD02529: {'created_time': 1774869504.170495, 'last_price_update_time': 1774869504.170506, 'auction_closing_time': 1774972785.0}
2026-03-30 11:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WD02529') HTTP/1.1" 204 0
2026-03-30 11:18:39 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.682(s), this was the 1st time calling it.
2026-03-30 11:18:39 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.3677707724044605 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:18:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:18:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PV12001/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AC65647/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD91591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:02 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.188(s), this was the 1st time calling it.
2026-03-30 11:19:02 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.231049385809741 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:19:05 [scrapy.extensions.logstats] INFO: Crawled 122 pages (at 9 pages/min), scraped 107 items (at 13 items/min)
2026-03-30 11:19:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH19496> (referer: https://www.auto1.com/v1/car-details-view/EH19496/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14dea4dd-3559-5a40-9bde-e4a8f3e62e9a with identifier: EH19496
2026-03-30 11:19:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14dea4dd-3559-5a40-9bde-e4a8f3e62e9a with scrape type 1
2026-03-30 11:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14dea4dd-3559-5a40-9bde-e4a8f3e62e9a
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa9%252Ff7a9fa1992eaa34fa9248999b247a8bd%252Fpa%252FEH19496_7b83e22789b568819e3e7ae0828cdf71.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_7b83e22789b568819e3e7ae0828cdf71.jpg not downloaded yet
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa9%252Ff7a9fa1992eaa34fa9248999b247a8bd%252Fpa%252FEH19496_4cd0a2fcb43e652dc5b3d3b1ffc2f5ec.png%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_4cd0a2fcb43e652dc5b3d3b1ffc2f5ec.png not downloaded yet
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa9%252Ff7a9fa1992eaa34fa9248999b247a8bd%252Fpa%252FEH19496_7137185d0524499956ff0d3424e125c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_7137185d0524499956ff0d3424e125c3.jpg not downloaded yet
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa9%252Ff7a9fa1992eaa34fa9248999b247a8bd%252Fpa%252FEH19496_13e3ce69f98dd74a497e3339f644f57a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_13e3ce69f98dd74a497e3339f644f57a.jpg not downloaded yet
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa9%252Ff7a9fa1992eaa34fa9248999b247a8bd%252Fpa%252FEH19496_0439a509b0825a1a0dd7111645ab81be.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_0439a509b0825a1a0dd7111645ab81be.jpg not downloaded yet
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa9%252Ff7a9fa1992eaa34fa9248999b247a8bd%252Fpa%252FEH19496_882412a53180169c25497bdc2e66c33d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_882412a53180169c25497bdc2e66c33d.jpg not downloaded yet
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa9%252Ff7a9fa1992eaa34fa9248999b247a8bd%252Fpa%252FEH19496_3a2be1c89dc960e3d0f727ebe2f8e1fd.png%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_3a2be1c89dc960e3d0f727ebe2f8e1fd.png not downloaded yet
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa9%252Ff7a9fa1992eaa34fa9248999b247a8bd%252Fpa%252FEH19496_b786c561f7b67b9f0d00b48997467bf2.png%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_b786c561f7b67b9f0d00b48997467bf2.png not downloaded yet
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa9%252Ff7a9fa1992eaa34fa9248999b247a8bd%252Fpa%252FEH19496_39dab0f1cb1b4b53a796821b698b34af.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_39dab0f1cb1b4b53a796821b698b34af.jpg not downloaded yet
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa9%252Ff7a9fa1992eaa34fa9248999b247a8bd%252Fpa%252FEH19496_4631c8dd88ac8d0915427d162ef2162c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_4631c8dd88ac8d0915427d162ef2162c.jpg not downloaded yet
2026-03-30 11:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_7b83e22789b568819e3e7ae0828cdf71.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_4cd0a2fcb43e652dc5b3d3b1ffc2f5ec.png> (referer: https://www.auto1.com/)
2026-03-30 11:19:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_7137185d0524499956ff0d3424e125c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_4631c8dd88ac8d0915427d162ef2162c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_39dab0f1cb1b4b53a796821b698b34af.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_b786c561f7b67b9f0d00b48997467bf2.png> (referer: https://www.auto1.com/)
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384d8dd0>
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14dea4dd-3559-5a40-9bde-e4a8f3e62e9a/14dea4dd-3559-5a40-9bde-e4a8f3e62e9a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa9%252Ff7a9fa1992eaa34fa9248999b247a8bd%252Fpa%252FEH19496_7b83e22789b568819e3e7ae0828cdf71.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_7b83e22789b568819e3e7ae0828cdf71.jpg saved to cache
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14dea4dd-3559-5a40-9bde-e4a8f3e62e9a
2026-03-30 11:19:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_882412a53180169c25497bdc2e66c33d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_0439a509b0825a1a0dd7111645ab81be.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_3a2be1c89dc960e3d0f727ebe2f8e1fd.png> (referer: https://www.auto1.com/)
2026-03-30 11:19:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:19:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738783790>
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14dea4dd-3559-5a40-9bde-e4a8f3e62e9a/14dea4dd-3559-5a40-9bde-e4a8f3e62e9a_image_1.png HTTP/1.1" 201 0
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa9%252Ff7a9fa1992eaa34fa9248999b247a8bd%252Fpa%252FEH19496_4cd0a2fcb43e652dc5b3d3b1ffc2f5ec.png') HTTP/1.1" 204 0
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_4cd0a2fcb43e652dc5b3d3b1ffc2f5ec.png saved to cache
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14dea4dd-3559-5a40-9bde-e4a8f3e62e9a
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073867c1d0>
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14dea4dd-3559-5a40-9bde-e4a8f3e62e9a/14dea4dd-3559-5a40-9bde-e4a8f3e62e9a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa9%252Ff7a9fa1992eaa34fa9248999b247a8bd%252Fpa%252FEH19496_7137185d0524499956ff0d3424e125c3.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_7137185d0524499956ff0d3424e125c3.jpg saved to cache
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14dea4dd-3559-5a40-9bde-e4a8f3e62e9a
2026-03-30 11:19:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_13e3ce69f98dd74a497e3339f644f57a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384db150>
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14dea4dd-3559-5a40-9bde-e4a8f3e62e9a/14dea4dd-3559-5a40-9bde-e4a8f3e62e9a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa9%252Ff7a9fa1992eaa34fa9248999b247a8bd%252Fpa%252FEH19496_4631c8dd88ac8d0915427d162ef2162c.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_4631c8dd88ac8d0915427d162ef2162c.jpg saved to cache
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 14dea4dd-3559-5a40-9bde-e4a8f3e62e9a
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384c0bd0>
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14dea4dd-3559-5a40-9bde-e4a8f3e62e9a/14dea4dd-3559-5a40-9bde-e4a8f3e62e9a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa9%252Ff7a9fa1992eaa34fa9248999b247a8bd%252Fpa%252FEH19496_39dab0f1cb1b4b53a796821b698b34af.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_39dab0f1cb1b4b53a796821b698b34af.jpg saved to cache
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 14dea4dd-3559-5a40-9bde-e4a8f3e62e9a
2026-03-30 11:19:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:19:06 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:19:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0739412f90>
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14dea4dd-3559-5a40-9bde-e4a8f3e62e9a/14dea4dd-3559-5a40-9bde-e4a8f3e62e9a_image_7.png HTTP/1.1" 201 0
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa9%252Ff7a9fa1992eaa34fa9248999b247a8bd%252Fpa%252FEH19496_b786c561f7b67b9f0d00b48997467bf2.png') HTTP/1.1" 204 0
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_b786c561f7b67b9f0d00b48997467bf2.png saved to cache
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14dea4dd-3559-5a40-9bde-e4a8f3e62e9a
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384bcb90>
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14dea4dd-3559-5a40-9bde-e4a8f3e62e9a/14dea4dd-3559-5a40-9bde-e4a8f3e62e9a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa9%252Ff7a9fa1992eaa34fa9248999b247a8bd%252Fpa%252FEH19496_882412a53180169c25497bdc2e66c33d.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_882412a53180169c25497bdc2e66c33d.jpg saved to cache
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14dea4dd-3559-5a40-9bde-e4a8f3e62e9a
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384287d0>
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14dea4dd-3559-5a40-9bde-e4a8f3e62e9a/14dea4dd-3559-5a40-9bde-e4a8f3e62e9a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa9%252Ff7a9fa1992eaa34fa9248999b247a8bd%252Fpa%252FEH19496_0439a509b0825a1a0dd7111645ab81be.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_0439a509b0825a1a0dd7111645ab81be.jpg saved to cache
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14dea4dd-3559-5a40-9bde-e4a8f3e62e9a
2026-03-30 11:19:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:19:06 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:19:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384bed50>
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14dea4dd-3559-5a40-9bde-e4a8f3e62e9a/14dea4dd-3559-5a40-9bde-e4a8f3e62e9a_image_6.png HTTP/1.1" 201 0
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa9%252Ff7a9fa1992eaa34fa9248999b247a8bd%252Fpa%252FEH19496_3a2be1c89dc960e3d0f727ebe2f8e1fd.png') HTTP/1.1" 204 0
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_3a2be1c89dc960e3d0f727ebe2f8e1fd.png saved to cache
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14dea4dd-3559-5a40-9bde-e4a8f3e62e9a
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738727c50>
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14dea4dd-3559-5a40-9bde-e4a8f3e62e9a/14dea4dd-3559-5a40-9bde-e4a8f3e62e9a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa9%252Ff7a9fa1992eaa34fa9248999b247a8bd%252Fpa%252FEH19496_13e3ce69f98dd74a497e3339f644f57a.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_13e3ce69f98dd74a497e3339f644f57a.jpg saved to cache
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14dea4dd-3559-5a40-9bde-e4a8f3e62e9a
2026-03-30 11:19:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14dea4dd-3559-5a40-9bde-e4a8f3e62e9a, skipping ID generation
2026-03-30 11:19:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14dea4dd-3559-5a40-9bde-e4a8f3e62e9a with scrape type 1
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14dea4dd-3559-5a40-9bde-e4a8f3e62e9a sending to next pipeline
2026-03-30 11:19:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 14dea4dd-3559-5a40-9bde-e4a8f3e62e9a, identifier: EH19496
2026-03-30 11:19:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 14dea4dd-3559-5a40-9bde-e4a8f3e62e9a with identifier: EH19496
2026-03-30 11:19:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 14dea4dd-3559-5a40-9bde-e4a8f3e62e9a with identifier: EH19496
2026-03-30 11:19:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 14dea4dd-3559-5a40-9bde-e4a8f3e62e9a with identifier: EH19496 to the API
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_13e3ce69f98dd74a497e3339f644f57a.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:22:41Z',
'fuel_type': 'hybrid',
'id': '14dea4dd-3559-5a40-9bde-e4a8f3e62e9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH19496',
'listing': 'auction',
'location': 'FR, Mitry Mory',
'make': 'Jeep',
'model': 'Compass',
'odometer': 124671,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14dea4dd-3559-5a40-9bde-e4a8f3e62e9a/14dea4dd-3559-5a40-9bde-e4a8f3e62e9a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_7b83e22789b568819e3e7ae0828cdf71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14dea4dd-3559-5a40-9bde-e4a8f3e62e9a/14dea4dd-3559-5a40-9bde-e4a8f3e62e9a_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_4cd0a2fcb43e652dc5b3d3b1ffc2f5ec.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14dea4dd-3559-5a40-9bde-e4a8f3e62e9a/14dea4dd-3559-5a40-9bde-e4a8f3e62e9a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_7137185d0524499956ff0d3424e125c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14dea4dd-3559-5a40-9bde-e4a8f3e62e9a/14dea4dd-3559-5a40-9bde-e4a8f3e62e9a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47481,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_13e3ce69f98dd74a497e3339f644f57a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14dea4dd-3559-5a40-9bde-e4a8f3e62e9a/14dea4dd-3559-5a40-9bde-e4a8f3e62e9a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35867,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_0439a509b0825a1a0dd7111645ab81be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14dea4dd-3559-5a40-9bde-e4a8f3e62e9a/14dea4dd-3559-5a40-9bde-e4a8f3e62e9a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44253,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_882412a53180169c25497bdc2e66c33d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14dea4dd-3559-5a40-9bde-e4a8f3e62e9a/14dea4dd-3559-5a40-9bde-e4a8f3e62e9a_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_3a2be1c89dc960e3d0f727ebe2f8e1fd.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14dea4dd-3559-5a40-9bde-e4a8f3e62e9a/14dea4dd-3559-5a40-9bde-e4a8f3e62e9a_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_b786c561f7b67b9f0d00b48997467bf2.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14dea4dd-3559-5a40-9bde-e4a8f3e62e9a/14dea4dd-3559-5a40-9bde-e4a8f3e62e9a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_39dab0f1cb1b4b53a796821b698b34af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14dea4dd-3559-5a40-9bde-e4a8f3e62e9a/14dea4dd-3559-5a40-9bde-e4a8f3e62e9a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60017,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a9/f7a9fa1992eaa34fa9248999b247a8bd/pa/EH19496_4631c8dd88ac8d0915427d162ef2162c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid Night Eagle',
'transmission': 'automatic',
'trim': 'Night Eagle',
'year': 2022}
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH19496%27 HTTP/1.1" 200 None
2026-03-30 11:19:07 [auto1.fr] INFO: Saving data for EH19496: {'created_time': 1774869547.047812, 'last_price_update_time': 1774869547.047827, 'auction_closing_time': 1774970561.0}
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EH19496') HTTP/1.1" 204 0
2026-03-30 11:19:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:19:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XB50119/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:12 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 263.218(s), this was the 2nd time calling it.
2026-03-30 11:19:12 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.648177940143148 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:17 [auto1.fr] INFO: Channel: 24h | Page: 14 | totalHits: 5567 | hits on page: 40
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: BC58235
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC58235%27 HTTP/1.1" 200 None
2026-03-30 11:19:17 [auto1.fr] INFO: Scrape type for BC58235: 1
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: XV47033
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: NP19915
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: PH75787
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: AF42565
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF42565%27 HTTP/1.1" 200 None
2026-03-30 11:19:17 [auto1.fr] INFO: Scrape type for AF42565: 1
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: VV35925
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: LC59253
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: NE46775
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: TY43577
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY43577%27 HTTP/1.1" 200 None
2026-03-30 11:19:17 [auto1.fr] INFO: Scrape type for TY43577: 2
2026-03-30 11:19:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daca1c3b-71fa-5966-a278-583b6ec51901 with identifier: TY43577
2026-03-30 11:19:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daca1c3b-71fa-5966-a278-583b6ec51901 with scrape type 2
2026-03-30 11:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item daca1c3b-71fa-5966-a278-583b6ec51901 with scrape type 2
2026-03-30 11:19:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: daca1c3b-71fa-5966-a278-583b6ec51901, identifier: TY43577
2026-03-30 11:19:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: daca1c3b-71fa-5966-a278-583b6ec51901 with identifier: TY43577
2026-03-30 11:19:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: daca1c3b-71fa-5966-a278-583b6ec51901 with identifier: TY43577
2026-03-30 11:19:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: daca1c3b-71fa-5966-a278-583b6ec51901 with identifier: TY43577 to the API
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-31T15:06:35Z',
'fuel_type': 'diesel',
'id': 'daca1c3b-71fa-5966-a278-583b6ec51901',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY43577',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 94015,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-16',
'seller_name': None,
'title': 'Citroen C3 1.5 Blue-HDi Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2022}
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY43577%27 HTTP/1.1" 200 None
2026-03-30 11:19:17 [auto1.fr] INFO: Saving data for TY43577: {'auction_closing_time': 1774969595.0, 'created_time': 1774297402.77958, 'last_price_update_time': 1774869557.654364}
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TY43577') HTTP/1.1" 204 0
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: XV86490
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: FX33595
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: CG96901
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: KE60307
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: ET54199
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET54199%27 HTTP/1.1" 200 None
2026-03-30 11:19:17 [auto1.fr] INFO: Scrape type for ET54199: 1
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: JC74188
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC74188%27 HTTP/1.1" 200 None
2026-03-30 11:19:17 [auto1.fr] INFO: Scrape type for JC74188: 1
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: BD23405
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: ME79644
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: SA42500
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SA42500%27 HTTP/1.1" 200 None
2026-03-30 11:19:17 [auto1.fr] INFO: Scrape type for SA42500: 1
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: CE57838
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: GZ24181
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: PY19050
2026-03-30 11:19:17 [auto1.fr] INFO: Found listing with ID: NE95829
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE95829%27 HTTP/1.1" 200 None
2026-03-30 11:19:17 [auto1.fr] INFO: Scrape type for NE95829: 2
2026-03-30 11:19:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a30226e3-c7b2-5edf-b637-54a08b8fd0a8 with identifier: NE95829
2026-03-30 11:19:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a30226e3-c7b2-5edf-b637-54a08b8fd0a8 with scrape type 2
2026-03-30 11:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a30226e3-c7b2-5edf-b637-54a08b8fd0a8 with scrape type 2
2026-03-30 11:19:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a30226e3-c7b2-5edf-b637-54a08b8fd0a8, identifier: NE95829
2026-03-30 11:19:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a30226e3-c7b2-5edf-b637-54a08b8fd0a8 with identifier: NE95829
2026-03-30 11:19:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a30226e3-c7b2-5edf-b637-54a08b8fd0a8 with identifier: NE95829
2026-03-30 11:19:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a30226e3-c7b2-5edf-b637-54a08b8fd0a8 with identifier: NE95829 to the API
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:01:34Z',
'fuel_type': 'diesel',
'id': 'a30226e3-c7b2-5edf-b637-54a08b8fd0a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE95829',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 251856,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-03-09',
'seller_name': None,
'title': 'Peugeot 308 1.6 HDi Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2008}
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE95829%27 HTTP/1.1" 200 None
2026-03-30 11:19:18 [auto1.fr] INFO: Saving data for NE95829: {'auction_closing_time': 1774969294.0, 'created_time': 1773674141.754838, 'last_price_update_time': 1774869558.339427}
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NE95829') HTTP/1.1" 204 0
2026-03-30 11:19:18 [auto1.fr] INFO: Found listing with ID: JT01399
2026-03-30 11:19:18 [auto1.fr] INFO: Found listing with ID: KY00599
2026-03-30 11:19:18 [auto1.fr] INFO: Found listing with ID: WJ65165
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ65165%27 HTTP/1.1" 200 None
2026-03-30 11:19:18 [auto1.fr] INFO: Scrape type for WJ65165: 1
2026-03-30 11:19:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:19:18 [auto1.fr] INFO: Found listing with ID: BR78024
2026-03-30 11:19:18 [auto1.fr] INFO: Found listing with ID: ZT40530
2026-03-30 11:19:18 [auto1.fr] INFO: Found listing with ID: UA18339
2026-03-30 11:19:18 [auto1.fr] INFO: Found listing with ID: WU09307
2026-03-30 11:19:18 [auto1.fr] INFO: Found listing with ID: YS04060
2026-03-30 11:19:18 [auto1.fr] INFO: Found listing with ID: NH60039
2026-03-30 11:19:18 [auto1.fr] INFO: Found listing with ID: WV56090
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV56090%27 HTTP/1.1" 200 None
2026-03-30 11:19:18 [auto1.fr] INFO: Scrape type for WV56090: 2
2026-03-30 11:19:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9b23a87-4f2c-5744-ad62-6afaa5cec123 with identifier: WV56090
2026-03-30 11:19:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b23a87-4f2c-5744-ad62-6afaa5cec123 with scrape type 2
2026-03-30 11:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9b23a87-4f2c-5744-ad62-6afaa5cec123 with scrape type 2
2026-03-30 11:19:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a9b23a87-4f2c-5744-ad62-6afaa5cec123, identifier: WV56090
2026-03-30 11:19:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a9b23a87-4f2c-5744-ad62-6afaa5cec123 with identifier: WV56090
2026-03-30 11:19:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a9b23a87-4f2c-5744-ad62-6afaa5cec123 with identifier: WV56090
2026-03-30 11:19:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a9b23a87-4f2c-5744-ad62-6afaa5cec123 with identifier: WV56090 to the API
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:43:44Z',
'fuel_type': 'petrol',
'id': 'a9b23a87-4f2c-5744-ad62-6afaa5cec123',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV56090',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 68552,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-04',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2014}
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV56090%27 HTTP/1.1" 200 None
2026-03-30 11:19:18 [auto1.fr] INFO: Saving data for WV56090: {'auction_closing_time': 1774971824.0, 'created_time': 1773076951.522094, 'last_price_update_time': 1774869558.907694}
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WV56090') HTTP/1.1" 204 0
2026-03-30 11:19:18 [auto1.fr] INFO: Found listing with ID: NV07534
2026-03-30 11:19:18 [auto1.fr] INFO: Found listing with ID: WX18382
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX18382%27 HTTP/1.1" 200 None
2026-03-30 11:19:18 [auto1.fr] INFO: Scrape type for WX18382: 1
2026-03-30 11:19:18 [auto1.fr] INFO: Found listing with ID: LT10059
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT10059%27 HTTP/1.1" 200 None
2026-03-30 11:19:18 [auto1.fr] INFO: Scrape type for LT10059: 1
2026-03-30 11:19:18 [auto1.fr] INFO: Found listing with ID: ZL96278
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZL96278%27 HTTP/1.1" 200 None
2026-03-30 11:19:18 [auto1.fr] INFO: Scrape type for ZL96278: 1
2026-03-30 11:19:18 [auto1.fr] INFO: Found listing with ID: GS44106
2026-03-30 11:19:18 [auto1.fr] INFO: Found listing with ID: DS47849
2026-03-30 11:19:18 [auto1.fr] INFO: Found listing with ID: AB23264
2026-03-30 11:19:18 [auto1.fr] INFO: Found listing with ID: SE79976
2026-03-30 11:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE79976%27 HTTP/1.1" 200 None
2026-03-30 11:19:19 [auto1.fr] INFO: Scrape type for SE79976: 1
2026-03-30 11:19:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EY29396/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HY90819> (referer: https://www.auto1.com/v1/car-details-view/HY90819/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f372369c-8cf7-5bb5-a345-ce23b5e14d5d with identifier: HY90819
2026-03-30 11:19:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f372369c-8cf7-5bb5-a345-ce23b5e14d5d with scrape type 1
2026-03-30 11:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f372369c-8cf7-5bb5-a345-ce23b5e14d5d
2026-03-30 11:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F96%252F0a9638ce6f55b56b147ffb3a242740c4%252Fpa%252FHY90819_94641b1044e4eb1d1aa8da1803498343.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_94641b1044e4eb1d1aa8da1803498343.jpg not downloaded yet
2026-03-30 11:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F96%252F0a9638ce6f55b56b147ffb3a242740c4%252Fpa%252FHY90819_cc6b4f66325a5a72680b7817abc4715f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_cc6b4f66325a5a72680b7817abc4715f.jpg not downloaded yet
2026-03-30 11:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F96%252F0a9638ce6f55b56b147ffb3a242740c4%252Fpa%252FHY90819_ebb7f153e927d573db19fb18f0b3c265.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_ebb7f153e927d573db19fb18f0b3c265.jpg not downloaded yet
2026-03-30 11:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F96%252F0a9638ce6f55b56b147ffb3a242740c4%252Fpa%252FHY90819_fcce016dcd05bed91424839bbccefab6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_fcce016dcd05bed91424839bbccefab6.jpg not downloaded yet
2026-03-30 11:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F96%252F0a9638ce6f55b56b147ffb3a242740c4%252Fpa%252FHY90819_9fd1490b1cbabeb0de762ab519f81b47.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_9fd1490b1cbabeb0de762ab519f81b47.jpg not downloaded yet
2026-03-30 11:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F96%252F0a9638ce6f55b56b147ffb3a242740c4%252Fpa%252FHY90819_7af9932503087023b65eb868c2e09e94.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_7af9932503087023b65eb868c2e09e94.jpg not downloaded yet
2026-03-30 11:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F96%252F0a9638ce6f55b56b147ffb3a242740c4%252Fpa%252FHY90819_51d968775a49036a49f4a3da632b199d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_51d968775a49036a49f4a3da632b199d.jpg not downloaded yet
2026-03-30 11:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F96%252F0a9638ce6f55b56b147ffb3a242740c4%252Fpa%252FHY90819_b6e83b195da4c387faf5ca8c9606a2e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_b6e83b195da4c387faf5ca8c9606a2e9.jpg not downloaded yet
2026-03-30 11:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F96%252F0a9638ce6f55b56b147ffb3a242740c4%252Fpa%252FHY90819_f4c1c2d7b4aaaddf9ddfbd494455888e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_f4c1c2d7b4aaaddf9ddfbd494455888e.jpg not downloaded yet
2026-03-30 11:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F96%252F0a9638ce6f55b56b147ffb3a242740c4%252Fpa%252FHY90819_1f892d6d3d10852feb6d478f233199e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_1f892d6d3d10852feb6d478f233199e9.jpg not downloaded yet
2026-03-30 11:19:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AC65647> (referer: https://www.auto1.com/v1/car-details-view/AC65647/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_1f892d6d3d10852feb6d478f233199e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d28be7e-f935-5315-ba9b-61f1c8e7b03b with identifier: AC65647
2026-03-30 11:19:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d28be7e-f935-5315-ba9b-61f1c8e7b03b with scrape type 1
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d28be7e-f935-5315-ba9b-61f1c8e7b03b
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3a%252F0e3aaf8a5bff09bdf757e37319576634%252Fpa%252FAC65647_9866c009b5d8690c62df4a0678d2c8b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_9866c009b5d8690c62df4a0678d2c8b1.jpg already downloaded
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3a%252F0e3aaf8a5bff09bdf757e37319576634%252Fpa%252FAC65647_ba6818f0b423acb019fe457358ce2bf9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_ba6818f0b423acb019fe457358ce2bf9.jpg already downloaded
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3a%252F0e3aaf8a5bff09bdf757e37319576634%252Fpa%252FAC65647_3712f755d2a1468cecb765d5ab56aecf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_3712f755d2a1468cecb765d5ab56aecf.jpg already downloaded
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3a%252F0e3aaf8a5bff09bdf757e37319576634%252Fpa%252FAC65647_a3bac2777b9929fb1d1de05b8a63738a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_a3bac2777b9929fb1d1de05b8a63738a.jpg not downloaded yet
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3a%252F0e3aaf8a5bff09bdf757e37319576634%252Fpa%252FAC65647_4ef69ad90aa0c0a2366412e4f9bfca6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_4ef69ad90aa0c0a2366412e4f9bfca6a.jpg not downloaded yet
2026-03-30 11:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_f4c1c2d7b4aaaddf9ddfbd494455888e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3a%252F0e3aaf8a5bff09bdf757e37319576634%252Fpa%252FAC65647_50cf1bcd78dc506ab952c63d845ed1a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_50cf1bcd78dc506ab952c63d845ed1a7.jpg not downloaded yet
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384b0dd0>
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f372369c-8cf7-5bb5-a345-ce23b5e14d5d/f372369c-8cf7-5bb5-a345-ce23b5e14d5d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F96%252F0a9638ce6f55b56b147ffb3a242740c4%252Fpa%252FHY90819_1f892d6d3d10852feb6d478f233199e9.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_1f892d6d3d10852feb6d478f233199e9.jpg saved to cache
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f372369c-8cf7-5bb5-a345-ce23b5e14d5d
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3a%252F0e3aaf8a5bff09bdf757e37319576634%252Fpa%252FAC65647_0df2dff53fff8e172012e63f0dfe090c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_0df2dff53fff8e172012e63f0dfe090c.jpg not downloaded yet
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738457c50>
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f372369c-8cf7-5bb5-a345-ce23b5e14d5d/f372369c-8cf7-5bb5-a345-ce23b5e14d5d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F96%252F0a9638ce6f55b56b147ffb3a242740c4%252Fpa%252FHY90819_f4c1c2d7b4aaaddf9ddfbd494455888e.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_f4c1c2d7b4aaaddf9ddfbd494455888e.jpg saved to cache
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f372369c-8cf7-5bb5-a345-ce23b5e14d5d
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3a%252F0e3aaf8a5bff09bdf757e37319576634%252Fpa%252FAC65647_bffb2897608d7025c7c171164ec1718a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_bffb2897608d7025c7c171164ec1718a.jpg already downloaded
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3a%252F0e3aaf8a5bff09bdf757e37319576634%252Fpa%252FAC65647_980121796ab9204a06bebdfd1d8c9a7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_980121796ab9204a06bebdfd1d8c9a7e.jpg already downloaded
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3a%252F0e3aaf8a5bff09bdf757e37319576634%252Fpa%252FAC65647_723c6f014ccfdff47dd58f426cc3c648.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_723c6f014ccfdff47dd58f426cc3c648.jpg already downloaded
2026-03-30 11:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_4ef69ad90aa0c0a2366412e4f9bfca6a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738668610>
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d28be7e-f935-5315-ba9b-61f1c8e7b03b/1d28be7e-f935-5315-ba9b-61f1c8e7b03b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3a%252F0e3aaf8a5bff09bdf757e37319576634%252Fpa%252FAC65647_4ef69ad90aa0c0a2366412e4f9bfca6a.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_4ef69ad90aa0c0a2366412e4f9bfca6a.jpg saved to cache
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d28be7e-f935-5315-ba9b-61f1c8e7b03b
2026-03-30 11:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_0df2dff53fff8e172012e63f0dfe090c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383f0150>
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d28be7e-f935-5315-ba9b-61f1c8e7b03b/1d28be7e-f935-5315-ba9b-61f1c8e7b03b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3a%252F0e3aaf8a5bff09bdf757e37319576634%252Fpa%252FAC65647_0df2dff53fff8e172012e63f0dfe090c.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_0df2dff53fff8e172012e63f0dfe090c.jpg saved to cache
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d28be7e-f935-5315-ba9b-61f1c8e7b03b
2026-03-30 11:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_50cf1bcd78dc506ab952c63d845ed1a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_a3bac2777b9929fb1d1de05b8a63738a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738464a90>
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d28be7e-f935-5315-ba9b-61f1c8e7b03b/1d28be7e-f935-5315-ba9b-61f1c8e7b03b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3a%252F0e3aaf8a5bff09bdf757e37319576634%252Fpa%252FAC65647_50cf1bcd78dc506ab952c63d845ed1a7.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_50cf1bcd78dc506ab952c63d845ed1a7.jpg saved to cache
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d28be7e-f935-5315-ba9b-61f1c8e7b03b
2026-03-30 11:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_b6e83b195da4c387faf5ca8c9606a2e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384af250>
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d28be7e-f935-5315-ba9b-61f1c8e7b03b/1d28be7e-f935-5315-ba9b-61f1c8e7b03b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3a%252F0e3aaf8a5bff09bdf757e37319576634%252Fpa%252FAC65647_a3bac2777b9929fb1d1de05b8a63738a.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_a3bac2777b9929fb1d1de05b8a63738a.jpg saved to cache
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d28be7e-f935-5315-ba9b-61f1c8e7b03b
2026-03-30 11:19:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d28be7e-f935-5315-ba9b-61f1c8e7b03b, skipping ID generation
2026-03-30 11:19:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d28be7e-f935-5315-ba9b-61f1c8e7b03b with scrape type 1
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d28be7e-f935-5315-ba9b-61f1c8e7b03b sending to next pipeline
2026-03-30 11:19:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1d28be7e-f935-5315-ba9b-61f1c8e7b03b, identifier: AC65647
2026-03-30 11:19:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1d28be7e-f935-5315-ba9b-61f1c8e7b03b with identifier: AC65647
2026-03-30 11:19:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1d28be7e-f935-5315-ba9b-61f1c8e7b03b with identifier: AC65647
2026-03-30 11:19:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1d28be7e-f935-5315-ba9b-61f1c8e7b03b with identifier: AC65647 to the API
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_a3bac2777b9929fb1d1de05b8a63738a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:36:56Z',
'fuel_type': 'diesel',
'id': '1d28be7e-f935-5315-ba9b-61f1c8e7b03b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC65647',
'listing': 'auction',
'location': 'FR, Saint Aignan de Grandlieu',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 244035,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d28be7e-f935-5315-ba9b-61f1c8e7b03b/1d28be7e-f935-5315-ba9b-61f1c8e7b03b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82760,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_9866c009b5d8690c62df4a0678d2c8b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d28be7e-f935-5315-ba9b-61f1c8e7b03b/1d28be7e-f935-5315-ba9b-61f1c8e7b03b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86198,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_ba6818f0b423acb019fe457358ce2bf9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d28be7e-f935-5315-ba9b-61f1c8e7b03b/1d28be7e-f935-5315-ba9b-61f1c8e7b03b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2867299,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_3712f755d2a1468cecb765d5ab56aecf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d28be7e-f935-5315-ba9b-61f1c8e7b03b/1d28be7e-f935-5315-ba9b-61f1c8e7b03b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_a3bac2777b9929fb1d1de05b8a63738a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d28be7e-f935-5315-ba9b-61f1c8e7b03b/1d28be7e-f935-5315-ba9b-61f1c8e7b03b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_4ef69ad90aa0c0a2366412e4f9bfca6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d28be7e-f935-5315-ba9b-61f1c8e7b03b/1d28be7e-f935-5315-ba9b-61f1c8e7b03b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77146,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_50cf1bcd78dc506ab952c63d845ed1a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d28be7e-f935-5315-ba9b-61f1c8e7b03b/1d28be7e-f935-5315-ba9b-61f1c8e7b03b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_0df2dff53fff8e172012e63f0dfe090c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d28be7e-f935-5315-ba9b-61f1c8e7b03b/1d28be7e-f935-5315-ba9b-61f1c8e7b03b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82644,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_bffb2897608d7025c7c171164ec1718a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d28be7e-f935-5315-ba9b-61f1c8e7b03b/1d28be7e-f935-5315-ba9b-61f1c8e7b03b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_980121796ab9204a06bebdfd1d8c9a7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d28be7e-f935-5315-ba9b-61f1c8e7b03b/1d28be7e-f935-5315-ba9b-61f1c8e7b03b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/3a/0e3aaf8a5bff09bdf757e37319576634/pa/AC65647_723c6f014ccfdff47dd58f426cc3c648.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-10-07',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2012}
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC65647%27 HTTP/1.1" 200 None
2026-03-30 11:19:39 [auto1.fr] INFO: Saving data for AC65647: {'created_time': 1774869579.771659, 'last_price_update_time': 1774869579.771672, 'auction_closing_time': 1774971416.0}
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AC65647') HTTP/1.1" 204 0
2026-03-30 11:19:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_51d968775a49036a49f4a3da632b199d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD91591> (referer: https://www.auto1.com/v1/car-details-view/MD91591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384adc90>
2026-03-30 11:19:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f372369c-8cf7-5bb5-a345-ce23b5e14d5d/f372369c-8cf7-5bb5-a345-ce23b5e14d5d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F96%252F0a9638ce6f55b56b147ffb3a242740c4%252Fpa%252FHY90819_b6e83b195da4c387faf5ca8c9606a2e9.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_b6e83b195da4c387faf5ca8c9606a2e9.jpg saved to cache
2026-03-30 11:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f372369c-8cf7-5bb5-a345-ce23b5e14d5d
2026-03-30 11:19:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383c2810>
2026-03-30 11:19:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f372369c-8cf7-5bb5-a345-ce23b5e14d5d/f372369c-8cf7-5bb5-a345-ce23b5e14d5d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F96%252F0a9638ce6f55b56b147ffb3a242740c4%252Fpa%252FHY90819_51d968775a49036a49f4a3da632b199d.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_51d968775a49036a49f4a3da632b199d.jpg saved to cache
2026-03-30 11:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f372369c-8cf7-5bb5-a345-ce23b5e14d5d
2026-03-30 11:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_7af9932503087023b65eb868c2e09e94.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_9fd1490b1cbabeb0de762ab519f81b47.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 230ccc38-97c5-5b40-b50e-4143e0246d61 with identifier: MD91591
2026-03-30 11:19:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 230ccc38-97c5-5b40-b50e-4143e0246d61 with scrape type 1
2026-03-30 11:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 230ccc38-97c5-5b40-b50e-4143e0246d61
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fed%252F13ed2d33f474a94a3622ead009a329a8%252Fpa%252FMD91591_460e3e7df780fa18aa70752c00922996.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/ed/13ed2d33f474a94a3622ead009a329a8/pa/MD91591_460e3e7df780fa18aa70752c00922996.jpg already downloaded
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fed%252F13ed2d33f474a94a3622ead009a329a8%252Fpa%252FMD91591_0091448985194bc7b55367a76d838585.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/ed/13ed2d33f474a94a3622ead009a329a8/pa/MD91591_0091448985194bc7b55367a76d838585.jpg already downloaded
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fed%252F13ed2d33f474a94a3622ead009a329a8%252Fpa%252FMD91591_5b32f030170520026ce280d5a57035df.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/ed/13ed2d33f474a94a3622ead009a329a8/pa/MD91591_5b32f030170520026ce280d5a57035df.jpg already downloaded
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fed%252F13ed2d33f474a94a3622ead009a329a8%252Fpa%252FMD91591_1c5a157dab61888b0c9075996beab2b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/ed/13ed2d33f474a94a3622ead009a329a8/pa/MD91591_1c5a157dab61888b0c9075996beab2b0.jpg already downloaded
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fed%252F13ed2d33f474a94a3622ead009a329a8%252Fpa%252FMD91591_61187b172caec72caa6498a483ad3369.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/ed/13ed2d33f474a94a3622ead009a329a8/pa/MD91591_61187b172caec72caa6498a483ad3369.jpg already downloaded
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fed%252F13ed2d33f474a94a3622ead009a329a8%252Fpa%252FMD91591_b7e785a3e0d6ca01258b316fd65bd425.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/ed/13ed2d33f474a94a3622ead009a329a8/pa/MD91591_b7e785a3e0d6ca01258b316fd65bd425.jpg already downloaded
2026-03-30 11:19:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 230ccc38-97c5-5b40-b50e-4143e0246d61, identifier: MD91591
2026-03-30 11:19:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 230ccc38-97c5-5b40-b50e-4143e0246d61 with identifier: MD91591
2026-03-30 11:19:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 230ccc38-97c5-5b40-b50e-4143e0246d61 with identifier: MD91591
2026-03-30 11:19:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 230ccc38-97c5-5b40-b50e-4143e0246d61 with identifier: MD91591 to the API
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MD91591>
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:56:21Z',
'fuel_type': 'diesel',
'id': '230ccc38-97c5-5b40-b50e-4143e0246d61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD91591',
'listing': 'auction',
'location': 'FR, CASTELNAU D’ESTRETEFONDS',
'make': 'Peugeot',
'model': '3008',
'odometer': 285013,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img13/ed/13ed2d33f474a94a3622ead009a329a8/pa/MD91591_460e3e7df780fa18aa70752c00922996.jpg',
'https://img-pa.auto1.com/img13/ed/13ed2d33f474a94a3622ead009a329a8/pa/MD91591_0091448985194bc7b55367a76d838585.jpg',
'https://img-pa.auto1.com/img13/ed/13ed2d33f474a94a3622ead009a329a8/pa/MD91591_5b32f030170520026ce280d5a57035df.jpg',
'https://img-pa.auto1.com/img13/ed/13ed2d33f474a94a3622ead009a329a8/pa/MD91591_1c5a157dab61888b0c9075996beab2b0.jpg',
'https://img-pa.auto1.com/img13/ed/13ed2d33f474a94a3622ead009a329a8/pa/MD91591_61187b172caec72caa6498a483ad3369.jpg',
'https://img-pa.auto1.com/img13/ed/13ed2d33f474a94a3622ead009a329a8/pa/MD91591_b7e785a3e0d6ca01258b316fd65bd425.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_230ccc38-97c5-5b40-b50e-4143e0246d61/230ccc38-97c5-5b40-b50e-4143e0246d61_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80309,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/ed/13ed2d33f474a94a3622ead009a329a8/pa/MD91591_460e3e7df780fa18aa70752c00922996.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_230ccc38-97c5-5b40-b50e-4143e0246d61/230ccc38-97c5-5b40-b50e-4143e0246d61_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93250,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/ed/13ed2d33f474a94a3622ead009a329a8/pa/MD91591_0091448985194bc7b55367a76d838585.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_230ccc38-97c5-5b40-b50e-4143e0246d61/230ccc38-97c5-5b40-b50e-4143e0246d61_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78618,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/ed/13ed2d33f474a94a3622ead009a329a8/pa/MD91591_5b32f030170520026ce280d5a57035df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_230ccc38-97c5-5b40-b50e-4143e0246d61/230ccc38-97c5-5b40-b50e-4143e0246d61_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81285,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/ed/13ed2d33f474a94a3622ead009a329a8/pa/MD91591_1c5a157dab61888b0c9075996beab2b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_230ccc38-97c5-5b40-b50e-4143e0246d61/230ccc38-97c5-5b40-b50e-4143e0246d61_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97904,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/ed/13ed2d33f474a94a3622ead009a329a8/pa/MD91591_61187b172caec72caa6498a483ad3369.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_230ccc38-97c5-5b40-b50e-4143e0246d61/230ccc38-97c5-5b40-b50e-4143e0246d61_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/ed/13ed2d33f474a94a3622ead009a329a8/pa/MD91591_b7e785a3e0d6ca01258b316fd65bd425.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-07-01',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2012}
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD91591%27 HTTP/1.1" 200 None
2026-03-30 11:19:41 [auto1.fr] INFO: Saving data for MD91591: {'created_time': 1774869581.218653, 'last_price_update_time': 1774869581.218665, 'auction_closing_time': 1774972581.0}
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MD91591') HTTP/1.1" 204 0
2026-03-30 11:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_ebb7f153e927d573db19fb18f0b3c265.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_fcce016dcd05bed91424839bbccefab6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073875c550>
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f372369c-8cf7-5bb5-a345-ce23b5e14d5d/f372369c-8cf7-5bb5-a345-ce23b5e14d5d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F96%252F0a9638ce6f55b56b147ffb3a242740c4%252Fpa%252FHY90819_7af9932503087023b65eb868c2e09e94.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_7af9932503087023b65eb868c2e09e94.jpg saved to cache
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f372369c-8cf7-5bb5-a345-ce23b5e14d5d
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738429650>
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f372369c-8cf7-5bb5-a345-ce23b5e14d5d/f372369c-8cf7-5bb5-a345-ce23b5e14d5d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F96%252F0a9638ce6f55b56b147ffb3a242740c4%252Fpa%252FHY90819_9fd1490b1cbabeb0de762ab519f81b47.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_9fd1490b1cbabeb0de762ab519f81b47.jpg saved to cache
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f372369c-8cf7-5bb5-a345-ce23b5e14d5d
2026-03-30 11:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_cc6b4f66325a5a72680b7817abc4715f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_94641b1044e4eb1d1aa8da1803498343.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383c4fd0>
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f372369c-8cf7-5bb5-a345-ce23b5e14d5d/f372369c-8cf7-5bb5-a345-ce23b5e14d5d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F96%252F0a9638ce6f55b56b147ffb3a242740c4%252Fpa%252FHY90819_ebb7f153e927d573db19fb18f0b3c265.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_ebb7f153e927d573db19fb18f0b3c265.jpg saved to cache
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f372369c-8cf7-5bb5-a345-ce23b5e14d5d
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073854b450>
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f372369c-8cf7-5bb5-a345-ce23b5e14d5d/f372369c-8cf7-5bb5-a345-ce23b5e14d5d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F96%252F0a9638ce6f55b56b147ffb3a242740c4%252Fpa%252FHY90819_fcce016dcd05bed91424839bbccefab6.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_fcce016dcd05bed91424839bbccefab6.jpg saved to cache
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f372369c-8cf7-5bb5-a345-ce23b5e14d5d
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385fe750>
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f372369c-8cf7-5bb5-a345-ce23b5e14d5d/f372369c-8cf7-5bb5-a345-ce23b5e14d5d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F96%252F0a9638ce6f55b56b147ffb3a242740c4%252Fpa%252FHY90819_cc6b4f66325a5a72680b7817abc4715f.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_cc6b4f66325a5a72680b7817abc4715f.jpg saved to cache
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f372369c-8cf7-5bb5-a345-ce23b5e14d5d
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385ce490>
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f372369c-8cf7-5bb5-a345-ce23b5e14d5d/f372369c-8cf7-5bb5-a345-ce23b5e14d5d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F96%252F0a9638ce6f55b56b147ffb3a242740c4%252Fpa%252FHY90819_94641b1044e4eb1d1aa8da1803498343.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_94641b1044e4eb1d1aa8da1803498343.jpg saved to cache
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f372369c-8cf7-5bb5-a345-ce23b5e14d5d
2026-03-30 11:19:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f372369c-8cf7-5bb5-a345-ce23b5e14d5d, skipping ID generation
2026-03-30 11:19:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f372369c-8cf7-5bb5-a345-ce23b5e14d5d with scrape type 1
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f372369c-8cf7-5bb5-a345-ce23b5e14d5d sending to next pipeline
2026-03-30 11:19:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f372369c-8cf7-5bb5-a345-ce23b5e14d5d, identifier: HY90819
2026-03-30 11:19:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f372369c-8cf7-5bb5-a345-ce23b5e14d5d with identifier: HY90819
2026-03-30 11:19:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f372369c-8cf7-5bb5-a345-ce23b5e14d5d with identifier: HY90819
2026-03-30 11:19:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f372369c-8cf7-5bb5-a345-ce23b5e14d5d with identifier: HY90819 to the API
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_94641b1044e4eb1d1aa8da1803498343.jpg>
{'auction_title': '',
'c_o_2_emission_value': 90,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:03:50Z',
'fuel_type': 'diesel',
'id': 'f372369c-8cf7-5bb5-a345-ce23b5e14d5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY90819',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Renault',
'model': 'Megane',
'odometer': 99060,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f372369c-8cf7-5bb5-a345-ce23b5e14d5d/f372369c-8cf7-5bb5-a345-ce23b5e14d5d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51482,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_94641b1044e4eb1d1aa8da1803498343.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f372369c-8cf7-5bb5-a345-ce23b5e14d5d/f372369c-8cf7-5bb5-a345-ce23b5e14d5d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55250,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_cc6b4f66325a5a72680b7817abc4715f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f372369c-8cf7-5bb5-a345-ce23b5e14d5d/f372369c-8cf7-5bb5-a345-ce23b5e14d5d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54290,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_ebb7f153e927d573db19fb18f0b3c265.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f372369c-8cf7-5bb5-a345-ce23b5e14d5d/f372369c-8cf7-5bb5-a345-ce23b5e14d5d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49050,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_fcce016dcd05bed91424839bbccefab6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f372369c-8cf7-5bb5-a345-ce23b5e14d5d/f372369c-8cf7-5bb5-a345-ce23b5e14d5d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57878,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_9fd1490b1cbabeb0de762ab519f81b47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f372369c-8cf7-5bb5-a345-ce23b5e14d5d/f372369c-8cf7-5bb5-a345-ce23b5e14d5d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58679,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_7af9932503087023b65eb868c2e09e94.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f372369c-8cf7-5bb5-a345-ce23b5e14d5d/f372369c-8cf7-5bb5-a345-ce23b5e14d5d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_51d968775a49036a49f4a3da632b199d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f372369c-8cf7-5bb5-a345-ce23b5e14d5d/f372369c-8cf7-5bb5-a345-ce23b5e14d5d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116187,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_b6e83b195da4c387faf5ca8c9606a2e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f372369c-8cf7-5bb5-a345-ce23b5e14d5d/f372369c-8cf7-5bb5-a345-ce23b5e14d5d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87406,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_f4c1c2d7b4aaaddf9ddfbd494455888e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f372369c-8cf7-5bb5-a345-ce23b5e14d5d/f372369c-8cf7-5bb5-a345-ce23b5e14d5d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81369,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/96/0a9638ce6f55b56b147ffb3a242740c4/pa/HY90819_1f892d6d3d10852feb6d478f233199e9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-04-02',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.5 dCi BOSE Edition',
'transmission': 'manual',
'trim': 'BOSE Edition',
'year': 2014}
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HY90819%27 HTTP/1.1" 200 None
2026-03-30 11:19:42 [auto1.fr] INFO: Saving data for HY90819: {'created_time': 1774869582.449494, 'last_price_update_time': 1774869582.449504, 'auction_closing_time': 1774969430.0}
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HY90819') HTTP/1.1" 204 0
2026-03-30 11:19:49 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.612(s), this was the 1st time calling it.
2026-03-30 11:19:49 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.518594921743858 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:19:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:19:59 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.649(s), this was the 2nd time calling it.
2026-03-30 11:19:59 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.208604859756976 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:20:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ND41633> (referer: https://www.auto1.com/v1/car-details-view/ND41633/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f181ef9-0ab6-548a-95de-8b61a676f0bc with identifier: ND41633
2026-03-30 11:20:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f181ef9-0ab6-548a-95de-8b61a676f0bc with scrape type 1
2026-03-30 11:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f181ef9-0ab6-548a-95de-8b61a676f0bc
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F01%252F8401ddfd85ef0c06872a157fc2167bf6%252Fpa%252FND41633_bc7b3e8744dce3f5b5079bd0b0a1e9a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_bc7b3e8744dce3f5b5079bd0b0a1e9a7.jpg not downloaded yet
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F01%252F8401ddfd85ef0c06872a157fc2167bf6%252Fpa%252FND41633_2d1281d13b47580fbee123ec82cdb973.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_2d1281d13b47580fbee123ec82cdb973.jpg not downloaded yet
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F01%252F8401ddfd85ef0c06872a157fc2167bf6%252Fpa%252FND41633_b73cc23f73c3f09662ec457259243291.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_b73cc23f73c3f09662ec457259243291.jpg not downloaded yet
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F01%252F8401ddfd85ef0c06872a157fc2167bf6%252Fpa%252FND41633_a2d2c82b59741ba4c05a663b13ccb856.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_a2d2c82b59741ba4c05a663b13ccb856.jpg not downloaded yet
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F01%252F8401ddfd85ef0c06872a157fc2167bf6%252Fpa%252FND41633_56e1d9d662874be80c9bae1a99eb1d2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_56e1d9d662874be80c9bae1a99eb1d2e.jpg not downloaded yet
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F01%252F8401ddfd85ef0c06872a157fc2167bf6%252Fpa%252FND41633_e7a2b7c07d71d543dcc0d1abed385ec2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_e7a2b7c07d71d543dcc0d1abed385ec2.jpg not downloaded yet
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F01%252F8401ddfd85ef0c06872a157fc2167bf6%252Fpa%252FND41633_dfd068abdd2b00f7f12ad4bfd82e5476.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_dfd068abdd2b00f7f12ad4bfd82e5476.jpg not downloaded yet
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F01%252F8401ddfd85ef0c06872a157fc2167bf6%252Fpa%252FND41633_b69f6975b20d01b789856832b7d6b840.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_b69f6975b20d01b789856832b7d6b840.jpg not downloaded yet
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F01%252F8401ddfd85ef0c06872a157fc2167bf6%252Fpa%252FND41633_a91e8d30cb985fa72c69c1e1cd6cd31b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_a91e8d30cb985fa72c69c1e1cd6cd31b.jpg not downloaded yet
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F01%252F8401ddfd85ef0c06872a157fc2167bf6%252Fpa%252FND41633_a45535d716e3b626c1057d708d2bf006.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_a45535d716e3b626c1057d708d2bf006.jpg not downloaded yet
2026-03-30 11:20:05 [scrapy.extensions.logstats] INFO: Crawled 130 pages (at 8 pages/min), scraped 114 items (at 7 items/min)
2026-03-30 11:20:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:20:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YW08307> (referer: https://www.auto1.com/v1/car-details-view/YW08307/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04 with identifier: YW08307
2026-03-30 11:20:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04 with scrape type 1
2026-03-30 11:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fcd%252F1acd89f71810cf630e095a83740d3638%252Fpa%252FYW08307_f8608365da7d744b24da06789ac116dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_f8608365da7d744b24da06789ac116dd.jpg not downloaded yet
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fcd%252F1acd89f71810cf630e095a83740d3638%252Fpa%252FYW08307_893e34ea68c09c7e8b274c58337c2a15.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_893e34ea68c09c7e8b274c58337c2a15.jpg not downloaded yet
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fcd%252F1acd89f71810cf630e095a83740d3638%252Fpa%252FYW08307_b2a16445c81bc0d5f5c9bc19536984f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_b2a16445c81bc0d5f5c9bc19536984f7.jpg not downloaded yet
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fcd%252F1acd89f71810cf630e095a83740d3638%252Fpa%252FYW08307_9031b0272cc525351dafb9769064d96a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_9031b0272cc525351dafb9769064d96a.jpg not downloaded yet
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fcd%252F1acd89f71810cf630e095a83740d3638%252Fpa%252FYW08307_1e8c7e5f1f0053461bdafd0466526644.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_1e8c7e5f1f0053461bdafd0466526644.jpg not downloaded yet
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fcd%252F1acd89f71810cf630e095a83740d3638%252Fpa%252FYW08307_59f6c9f63aed7301240f88f1e6fc427d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_59f6c9f63aed7301240f88f1e6fc427d.jpg not downloaded yet
2026-03-30 11:20:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_a45535d716e3b626c1057d708d2bf006.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fcd%252F1acd89f71810cf630e095a83740d3638%252Fpa%252FYW08307_35d2d0c42b2ca05b56fd08f8964fce9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_35d2d0c42b2ca05b56fd08f8964fce9a.jpg not downloaded yet
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fcd%252F1acd89f71810cf630e095a83740d3638%252Fpa%252FYW08307_341eecffd2589a8dd46da98a1009e4d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_341eecffd2589a8dd46da98a1009e4d3.jpg not downloaded yet
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fcd%252F1acd89f71810cf630e095a83740d3638%252Fpa%252FYW08307_758997013546d9caca5eaf28f033020a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_758997013546d9caca5eaf28f033020a.jpg not downloaded yet
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fcd%252F1acd89f71810cf630e095a83740d3638%252Fpa%252FYW08307_a187da64c45a4602292843fbec4bce65.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_a187da64c45a4602292843fbec4bce65.jpg not downloaded yet
2026-03-30 11:20:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384c76d0>
2026-03-30 11:20:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f181ef9-0ab6-548a-95de-8b61a676f0bc/8f181ef9-0ab6-548a-95de-8b61a676f0bc_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F01%252F8401ddfd85ef0c06872a157fc2167bf6%252Fpa%252FND41633_a45535d716e3b626c1057d708d2bf006.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_a45535d716e3b626c1057d708d2bf006.jpg saved to cache
2026-03-30 11:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f181ef9-0ab6-548a-95de-8b61a676f0bc
2026-03-30 11:20:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_59f6c9f63aed7301240f88f1e6fc427d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_a187da64c45a4602292843fbec4bce65.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738732710>
2026-03-30 11:20:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fcd%252F1acd89f71810cf630e095a83740d3638%252Fpa%252FYW08307_59f6c9f63aed7301240f88f1e6fc427d.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_59f6c9f63aed7301240f88f1e6fc427d.jpg saved to cache
2026-03-30 11:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-03-30 11:20:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738548090>
2026-03-30 11:20:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fcd%252F1acd89f71810cf630e095a83740d3638%252Fpa%252FYW08307_a187da64c45a4602292843fbec4bce65.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_a187da64c45a4602292843fbec4bce65.jpg saved to cache
2026-03-30 11:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-03-30 11:20:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:20:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_758997013546d9caca5eaf28f033020a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738533c90>
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fcd%252F1acd89f71810cf630e095a83740d3638%252Fpa%252FYW08307_758997013546d9caca5eaf28f033020a.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_758997013546d9caca5eaf28f033020a.jpg saved to cache
2026-03-30 11:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-03-30 11:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_341eecffd2589a8dd46da98a1009e4d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_35d2d0c42b2ca05b56fd08f8964fce9a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073860a190>
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fcd%252F1acd89f71810cf630e095a83740d3638%252Fpa%252FYW08307_341eecffd2589a8dd46da98a1009e4d3.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_341eecffd2589a8dd46da98a1009e4d3.jpg saved to cache
2026-03-30 11:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-03-30 11:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_1e8c7e5f1f0053461bdafd0466526644.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073842a810>
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fcd%252F1acd89f71810cf630e095a83740d3638%252Fpa%252FYW08307_35d2d0c42b2ca05b56fd08f8964fce9a.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_35d2d0c42b2ca05b56fd08f8964fce9a.jpg saved to cache
2026-03-30 11:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384eb110>
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fcd%252F1acd89f71810cf630e095a83740d3638%252Fpa%252FYW08307_1e8c7e5f1f0053461bdafd0466526644.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_1e8c7e5f1f0053461bdafd0466526644.jpg saved to cache
2026-03-30 11:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-03-30 11:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_9031b0272cc525351dafb9769064d96a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_b2a16445c81bc0d5f5c9bc19536984f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383f0590>
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fcd%252F1acd89f71810cf630e095a83740d3638%252Fpa%252FYW08307_9031b0272cc525351dafb9769064d96a.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_9031b0272cc525351dafb9769064d96a.jpg saved to cache
2026-03-30 11:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-03-30 11:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_893e34ea68c09c7e8b274c58337c2a15.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383f1e90>
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fcd%252F1acd89f71810cf630e095a83740d3638%252Fpa%252FYW08307_b2a16445c81bc0d5f5c9bc19536984f7.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_b2a16445c81bc0d5f5c9bc19536984f7.jpg saved to cache
2026-03-30 11:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-03-30 11:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_f8608365da7d744b24da06789ac116dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384e96d0>
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fcd%252F1acd89f71810cf630e095a83740d3638%252Fpa%252FYW08307_893e34ea68c09c7e8b274c58337c2a15.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_893e34ea68c09c7e8b274c58337c2a15.jpg saved to cache
2026-03-30 11:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385fe750>
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fcd%252F1acd89f71810cf630e095a83740d3638%252Fpa%252FYW08307_f8608365da7d744b24da06789ac116dd.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_f8608365da7d744b24da06789ac116dd.jpg saved to cache
2026-03-30 11:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04
2026-03-30 11:20:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04, skipping ID generation
2026-03-30 11:20:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04 with scrape type 1
2026-03-30 11:20:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04 sending to next pipeline
2026-03-30 11:20:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04, identifier: YW08307
2026-03-30 11:20:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04 with identifier: YW08307
2026-03-30 11:20:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04 with identifier: YW08307
2026-03-30 11:20:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04 with identifier: YW08307 to the API
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:20:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_f8608365da7d744b24da06789ac116dd.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:13:30Z',
'fuel_type': 'diesel',
'id': 'c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW08307',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 189267,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44388,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_f8608365da7d744b24da06789ac116dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46696,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_893e34ea68c09c7e8b274c58337c2a15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_b2a16445c81bc0d5f5c9bc19536984f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34341,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_9031b0272cc525351dafb9769064d96a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46155,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_1e8c7e5f1f0053461bdafd0466526644.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_59f6c9f63aed7301240f88f1e6fc427d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41959,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_35d2d0c42b2ca05b56fd08f8964fce9a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90986,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_341eecffd2589a8dd46da98a1009e4d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_758997013546d9caca5eaf28f033020a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04/c5ea7a6d-ba7c-5fec-bfd7-d609ec8f2a04_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54796,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/cd/1acd89f71810cf630e095a83740d3638/pa/YW08307_a187da64c45a4602292843fbec4bce65.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-01-07',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen Berlingo 1.6 Blue-HDi Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2018}
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YW08307%27 HTTP/1.1" 200 None
2026-03-30 11:20:08 [auto1.fr] INFO: Saving data for YW08307: {'created_time': 1774869608.598423, 'last_price_update_time': 1774869608.598435, 'auction_closing_time': 1774970010.0}
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YW08307') HTTP/1.1" 204 0
2026-03-30 11:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_a91e8d30cb985fa72c69c1e1cd6cd31b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BC58235/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384e8790>
2026-03-30 11:20:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f181ef9-0ab6-548a-95de-8b61a676f0bc/8f181ef9-0ab6-548a-95de-8b61a676f0bc_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F01%252F8401ddfd85ef0c06872a157fc2167bf6%252Fpa%252FND41633_a91e8d30cb985fa72c69c1e1cd6cd31b.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_a91e8d30cb985fa72c69c1e1cd6cd31b.jpg saved to cache
2026-03-30 11:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f181ef9-0ab6-548a-95de-8b61a676f0bc
2026-03-30 11:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_b69f6975b20d01b789856832b7d6b840.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_dfd068abdd2b00f7f12ad4bfd82e5476.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073875ce10>
2026-03-30 11:20:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f181ef9-0ab6-548a-95de-8b61a676f0bc/8f181ef9-0ab6-548a-95de-8b61a676f0bc_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F01%252F8401ddfd85ef0c06872a157fc2167bf6%252Fpa%252FND41633_b69f6975b20d01b789856832b7d6b840.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_b69f6975b20d01b789856832b7d6b840.jpg saved to cache
2026-03-30 11:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f181ef9-0ab6-548a-95de-8b61a676f0bc
2026-03-30 11:20:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738535850>
2026-03-30 11:20:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f181ef9-0ab6-548a-95de-8b61a676f0bc/8f181ef9-0ab6-548a-95de-8b61a676f0bc_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F01%252F8401ddfd85ef0c06872a157fc2167bf6%252Fpa%252FND41633_dfd068abdd2b00f7f12ad4bfd82e5476.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_dfd068abdd2b00f7f12ad4bfd82e5476.jpg saved to cache
2026-03-30 11:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f181ef9-0ab6-548a-95de-8b61a676f0bc
2026-03-30 11:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_e7a2b7c07d71d543dcc0d1abed385ec2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_56e1d9d662874be80c9bae1a99eb1d2e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_a2d2c82b59741ba4c05a663b13ccb856.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073842f650>
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f181ef9-0ab6-548a-95de-8b61a676f0bc/8f181ef9-0ab6-548a-95de-8b61a676f0bc_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F01%252F8401ddfd85ef0c06872a157fc2167bf6%252Fpa%252FND41633_e7a2b7c07d71d543dcc0d1abed385ec2.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_e7a2b7c07d71d543dcc0d1abed385ec2.jpg saved to cache
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f181ef9-0ab6-548a-95de-8b61a676f0bc
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a4fe910>
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f181ef9-0ab6-548a-95de-8b61a676f0bc/8f181ef9-0ab6-548a-95de-8b61a676f0bc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F01%252F8401ddfd85ef0c06872a157fc2167bf6%252Fpa%252FND41633_56e1d9d662874be80c9bae1a99eb1d2e.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_56e1d9d662874be80c9bae1a99eb1d2e.jpg saved to cache
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f181ef9-0ab6-548a-95de-8b61a676f0bc
2026-03-30 11:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_b73cc23f73c3f09662ec457259243291.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383f2090>
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f181ef9-0ab6-548a-95de-8b61a676f0bc/8f181ef9-0ab6-548a-95de-8b61a676f0bc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F01%252F8401ddfd85ef0c06872a157fc2167bf6%252Fpa%252FND41633_a2d2c82b59741ba4c05a663b13ccb856.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_a2d2c82b59741ba4c05a663b13ccb856.jpg saved to cache
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f181ef9-0ab6-548a-95de-8b61a676f0bc
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073842f390>
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f181ef9-0ab6-548a-95de-8b61a676f0bc/8f181ef9-0ab6-548a-95de-8b61a676f0bc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F01%252F8401ddfd85ef0c06872a157fc2167bf6%252Fpa%252FND41633_b73cc23f73c3f09662ec457259243291.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_b73cc23f73c3f09662ec457259243291.jpg saved to cache
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f181ef9-0ab6-548a-95de-8b61a676f0bc
2026-03-30 11:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF42565/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_2d1281d13b47580fbee123ec82cdb973.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_bc7b3e8744dce3f5b5079bd0b0a1e9a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383c2910>
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f181ef9-0ab6-548a-95de-8b61a676f0bc/8f181ef9-0ab6-548a-95de-8b61a676f0bc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F01%252F8401ddfd85ef0c06872a157fc2167bf6%252Fpa%252FND41633_2d1281d13b47580fbee123ec82cdb973.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_2d1281d13b47580fbee123ec82cdb973.jpg saved to cache
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f181ef9-0ab6-548a-95de-8b61a676f0bc
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383aa510>
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f181ef9-0ab6-548a-95de-8b61a676f0bc/8f181ef9-0ab6-548a-95de-8b61a676f0bc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F01%252F8401ddfd85ef0c06872a157fc2167bf6%252Fpa%252FND41633_bc7b3e8744dce3f5b5079bd0b0a1e9a7.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_bc7b3e8744dce3f5b5079bd0b0a1e9a7.jpg saved to cache
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f181ef9-0ab6-548a-95de-8b61a676f0bc
2026-03-30 11:20:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f181ef9-0ab6-548a-95de-8b61a676f0bc, skipping ID generation
2026-03-30 11:20:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f181ef9-0ab6-548a-95de-8b61a676f0bc with scrape type 1
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f181ef9-0ab6-548a-95de-8b61a676f0bc sending to next pipeline
2026-03-30 11:20:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8f181ef9-0ab6-548a-95de-8b61a676f0bc, identifier: ND41633
2026-03-30 11:20:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8f181ef9-0ab6-548a-95de-8b61a676f0bc with identifier: ND41633
2026-03-30 11:20:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8f181ef9-0ab6-548a-95de-8b61a676f0bc with identifier: ND41633
2026-03-30 11:20:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8f181ef9-0ab6-548a-95de-8b61a676f0bc with identifier: ND41633 to the API
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:20:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:20:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_bc7b3e8744dce3f5b5079bd0b0a1e9a7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:45:58Z',
'fuel_type': 'petrol',
'id': '8f181ef9-0ab6-548a-95de-8b61a676f0bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND41633',
'listing': 'auction',
'location': 'FR, Châtillon',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 84111,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f181ef9-0ab6-548a-95de-8b61a676f0bc/8f181ef9-0ab6-548a-95de-8b61a676f0bc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91691,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_bc7b3e8744dce3f5b5079bd0b0a1e9a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f181ef9-0ab6-548a-95de-8b61a676f0bc/8f181ef9-0ab6-548a-95de-8b61a676f0bc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90383,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_2d1281d13b47580fbee123ec82cdb973.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f181ef9-0ab6-548a-95de-8b61a676f0bc/8f181ef9-0ab6-548a-95de-8b61a676f0bc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93098,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_b73cc23f73c3f09662ec457259243291.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f181ef9-0ab6-548a-95de-8b61a676f0bc/8f181ef9-0ab6-548a-95de-8b61a676f0bc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75759,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_a2d2c82b59741ba4c05a663b13ccb856.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f181ef9-0ab6-548a-95de-8b61a676f0bc/8f181ef9-0ab6-548a-95de-8b61a676f0bc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_56e1d9d662874be80c9bae1a99eb1d2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f181ef9-0ab6-548a-95de-8b61a676f0bc/8f181ef9-0ab6-548a-95de-8b61a676f0bc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80049,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_e7a2b7c07d71d543dcc0d1abed385ec2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f181ef9-0ab6-548a-95de-8b61a676f0bc/8f181ef9-0ab6-548a-95de-8b61a676f0bc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69979,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_dfd068abdd2b00f7f12ad4bfd82e5476.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f181ef9-0ab6-548a-95de-8b61a676f0bc/8f181ef9-0ab6-548a-95de-8b61a676f0bc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81201,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_b69f6975b20d01b789856832b7d6b840.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f181ef9-0ab6-548a-95de-8b61a676f0bc/8f181ef9-0ab6-548a-95de-8b61a676f0bc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81887,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_a91e8d30cb985fa72c69c1e1cd6cd31b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f181ef9-0ab6-548a-95de-8b61a676f0bc/8f181ef9-0ab6-548a-95de-8b61a676f0bc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69657,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img84/01/8401ddfd85ef0c06872a157fc2167bf6/pa/ND41633_a45535d716e3b626c1057d708d2bf006.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-07',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A5 Sportback 40 TFSI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2019}
2026-03-30 11:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ND41633%27 HTTP/1.1" 200 None
2026-03-30 11:20:10 [auto1.fr] INFO: Saving data for ND41633: {'created_time': 1774869610.121259, 'last_price_update_time': 1774869610.12127, 'auction_closing_time': 1774971958.0}
2026-03-30 11:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ND41633') HTTP/1.1" 204 0
2026-03-30 11:20:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD85936/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE79976/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EY29396> (referer: https://www.auto1.com/v1/car-details-view/EY29396/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 503abdee-5553-5cf2-b5c2-95e189107c35 with identifier: EY29396
2026-03-30 11:20:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 503abdee-5553-5cf2-b5c2-95e189107c35 with scrape type 1
2026-03-30 11:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 503abdee-5553-5cf2-b5c2-95e189107c35
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Ffa%252F8afae77ca251db861483d34f17734bba%252Fpa%252FEY29396_a6acd019fc78b0c1124fd408854f4b65.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_a6acd019fc78b0c1124fd408854f4b65.jpg already downloaded
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Ffa%252F8afae77ca251db861483d34f17734bba%252Fpa%252FEY29396_3f099c3fc676f9d40ce3d4b4b021d075.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_3f099c3fc676f9d40ce3d4b4b021d075.jpg already downloaded
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Ffa%252F8afae77ca251db861483d34f17734bba%252Fpa%252FEY29396_b6a181912abe161b645a778a2062401b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_b6a181912abe161b645a778a2062401b.jpg already downloaded
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Ffa%252F8afae77ca251db861483d34f17734bba%252Fpa%252FEY29396_3becc960c3d240ab07737410967ffc95.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_3becc960c3d240ab07737410967ffc95.jpg already downloaded
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Ffa%252F8afae77ca251db861483d34f17734bba%252Fpa%252FEY29396_37471b16dfd057b6f60c4745e16f146e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_37471b16dfd057b6f60c4745e16f146e.jpg already downloaded
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Ffa%252F8afae77ca251db861483d34f17734bba%252Fpa%252FEY29396_f5699bbc6bc03e3b63d6cca1f03f7f02.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_f5699bbc6bc03e3b63d6cca1f03f7f02.jpg already downloaded
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Ffa%252F8afae77ca251db861483d34f17734bba%252Fpa%252FEY29396_8ec666c5957e4ed7ff935227d5bd50ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_8ec666c5957e4ed7ff935227d5bd50ae.jpg already downloaded
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Ffa%252F8afae77ca251db861483d34f17734bba%252Fpa%252FEY29396_440c27f0e7c389cefe9982706449b1f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_440c27f0e7c389cefe9982706449b1f9.jpg already downloaded
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Ffa%252F8afae77ca251db861483d34f17734bba%252Fpa%252FEY29396_a7c5cd2df0cf248cbefd18a944571164.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_a7c5cd2df0cf248cbefd18a944571164.jpg already downloaded
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Ffa%252F8afae77ca251db861483d34f17734bba%252Fpa%252FEY29396_53cb0622f68fb600c44dba4eb569953c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_53cb0622f68fb600c44dba4eb569953c.jpg already downloaded
2026-03-30 11:20:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 503abdee-5553-5cf2-b5c2-95e189107c35, identifier: EY29396
2026-03-30 11:20:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 503abdee-5553-5cf2-b5c2-95e189107c35 with identifier: EY29396
2026-03-30 11:20:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 503abdee-5553-5cf2-b5c2-95e189107c35 with identifier: EY29396
2026-03-30 11:20:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 503abdee-5553-5cf2-b5c2-95e189107c35 with identifier: EY29396 to the API
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:20:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:20:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EY29396>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:45:37Z',
'fuel_type': 'diesel',
'id': '503abdee-5553-5cf2-b5c2-95e189107c35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY29396',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 185651,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 19,
'photo_urls': ['https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_a6acd019fc78b0c1124fd408854f4b65.jpg',
'https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_3f099c3fc676f9d40ce3d4b4b021d075.jpg',
'https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_b6a181912abe161b645a778a2062401b.jpg',
'https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_3becc960c3d240ab07737410967ffc95.jpg',
'https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_37471b16dfd057b6f60c4745e16f146e.jpg',
'https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_f5699bbc6bc03e3b63d6cca1f03f7f02.jpg',
'https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_8ec666c5957e4ed7ff935227d5bd50ae.jpg',
'https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_440c27f0e7c389cefe9982706449b1f9.jpg',
'https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_a7c5cd2df0cf248cbefd18a944571164.jpg',
'https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_53cb0622f68fb600c44dba4eb569953c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_503abdee-5553-5cf2-b5c2-95e189107c35/503abdee-5553-5cf2-b5c2-95e189107c35_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49424,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_a6acd019fc78b0c1124fd408854f4b65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_503abdee-5553-5cf2-b5c2-95e189107c35/503abdee-5553-5cf2-b5c2-95e189107c35_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55167,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_3f099c3fc676f9d40ce3d4b4b021d075.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_503abdee-5553-5cf2-b5c2-95e189107c35/503abdee-5553-5cf2-b5c2-95e189107c35_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45574,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_b6a181912abe161b645a778a2062401b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_503abdee-5553-5cf2-b5c2-95e189107c35/503abdee-5553-5cf2-b5c2-95e189107c35_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_3becc960c3d240ab07737410967ffc95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_503abdee-5553-5cf2-b5c2-95e189107c35/503abdee-5553-5cf2-b5c2-95e189107c35_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54675,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_37471b16dfd057b6f60c4745e16f146e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_503abdee-5553-5cf2-b5c2-95e189107c35/503abdee-5553-5cf2-b5c2-95e189107c35_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99605,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_f5699bbc6bc03e3b63d6cca1f03f7f02.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_503abdee-5553-5cf2-b5c2-95e189107c35/503abdee-5553-5cf2-b5c2-95e189107c35_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104404,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_8ec666c5957e4ed7ff935227d5bd50ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_503abdee-5553-5cf2-b5c2-95e189107c35/503abdee-5553-5cf2-b5c2-95e189107c35_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102687,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_440c27f0e7c389cefe9982706449b1f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_503abdee-5553-5cf2-b5c2-95e189107c35/503abdee-5553-5cf2-b5c2-95e189107c35_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84631,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_a7c5cd2df0cf248cbefd18a944571164.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_503abdee-5553-5cf2-b5c2-95e189107c35/503abdee-5553-5cf2-b5c2-95e189107c35_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76873,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/fa/8afae77ca251db861483d34f17734bba/pa/EY29396_53cb0622f68fb600c44dba4eb569953c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-12-21',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.4 D-4D Dynamic',
'transmission': 'manual',
'trim': 'Dynamic',
'year': 2011}
2026-03-30 11:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY29396%27 HTTP/1.1" 200 None
2026-03-30 11:20:16 [auto1.fr] INFO: Saving data for EY29396: {'created_time': 1774869616.220333, 'last_price_update_time': 1774869616.220346, 'auction_closing_time': 1774971937.0}
2026-03-30 11:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EY29396') HTTP/1.1" 204 0
2026-03-30 11:20:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZL96278/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU26545/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WX18382/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LT10059/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:34 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.101(s), this was the 1st time calling it.
2026-03-30 11:20:34 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.662079620807473 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:36 [auto1.fr] INFO: Channel: 24h | Page: 15 | totalHits: 5570 | hits on page: 40
2026-03-30 11:20:36 [auto1.fr] INFO: Found listing with ID: DS47849
2026-03-30 11:20:36 [auto1.fr] INFO: Found listing with ID: AB23264
2026-03-30 11:20:36 [auto1.fr] INFO: Found listing with ID: SE79976
2026-03-30 11:20:36 [auto1.fr] INFO: Found listing with ID: PM05502
2026-03-30 11:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM05502%27 HTTP/1.1" 200 None
2026-03-30 11:20:36 [auto1.fr] INFO: Scrape type for PM05502: 2
2026-03-30 11:20:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6fcc856-40c7-59dd-9f02-0aaf51c2cf89 with identifier: PM05502
2026-03-30 11:20:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6fcc856-40c7-59dd-9f02-0aaf51c2cf89 with scrape type 2
2026-03-30 11:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6fcc856-40c7-59dd-9f02-0aaf51c2cf89 with scrape type 2
2026-03-30 11:20:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c6fcc856-40c7-59dd-9f02-0aaf51c2cf89, identifier: PM05502
2026-03-30 11:20:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c6fcc856-40c7-59dd-9f02-0aaf51c2cf89 with identifier: PM05502
2026-03-30 11:20:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c6fcc856-40c7-59dd-9f02-0aaf51c2cf89 with identifier: PM05502
2026-03-30 11:20:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c6fcc856-40c7-59dd-9f02-0aaf51c2cf89 with identifier: PM05502 to the API
2026-03-30 11:20:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:20:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:20:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:37:13Z',
'fuel_type': 'diesel',
'id': 'c6fcc856-40c7-59dd-9f02-0aaf51c2cf89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM05502',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 95430,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-13',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2019}
2026-03-30 11:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM05502%27 HTTP/1.1" 200 None
2026-03-30 11:20:37 [auto1.fr] INFO: Saving data for PM05502: {'auction_closing_time': 1774971433.0, 'created_time': 1773673907.415361, 'last_price_update_time': 1774869637.046849}
2026-03-30 11:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PM05502') HTTP/1.1" 204 0
2026-03-30 11:20:37 [auto1.fr] INFO: Found listing with ID: XB70912
2026-03-30 11:20:37 [auto1.fr] INFO: Found listing with ID: MT71985
2026-03-30 11:20:37 [auto1.fr] INFO: Found listing with ID: WM28466
2026-03-30 11:20:37 [auto1.fr] INFO: Found listing with ID: PF67996
2026-03-30 11:20:37 [auto1.fr] INFO: Found listing with ID: DH19170
2026-03-30 11:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH19170%27 HTTP/1.1" 200 None
2026-03-30 11:20:37 [auto1.fr] INFO: Scrape type for DH19170: 2
2026-03-30 11:20:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1a90a81-d66f-5f5c-9529-89a9f5491bc1 with identifier: DH19170
2026-03-30 11:20:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1a90a81-d66f-5f5c-9529-89a9f5491bc1 with scrape type 2
2026-03-30 11:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1a90a81-d66f-5f5c-9529-89a9f5491bc1 with scrape type 2
2026-03-30 11:20:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b1a90a81-d66f-5f5c-9529-89a9f5491bc1, identifier: DH19170
2026-03-30 11:20:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b1a90a81-d66f-5f5c-9529-89a9f5491bc1 with identifier: DH19170
2026-03-30 11:20:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b1a90a81-d66f-5f5c-9529-89a9f5491bc1 with identifier: DH19170
2026-03-30 11:20:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b1a90a81-d66f-5f5c-9529-89a9f5491bc1 with identifier: DH19170 to the API
2026-03-30 11:20:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:20:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:20:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:39:13Z',
'fuel_type': 'diesel',
'id': 'b1a90a81-d66f-5f5c-9529-89a9f5491bc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH19170',
'listing': 'auction',
'make': 'Seat',
'model': 'Altea',
'odometer': 321545,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-26',
'seller_name': None,
'title': 'Seat Altea 1.6 TDI Stylance / Style',
'transmission': 'manual',
'trim': 'Stylance / Style',
'year': 2013}
2026-03-30 11:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH19170%27 HTTP/1.1" 200 None
2026-03-30 11:20:37 [auto1.fr] INFO: Saving data for DH19170: {'auction_closing_time': 1774971553.0, 'created_time': 1773414368.136662, 'last_price_update_time': 1774869637.498799}
2026-03-30 11:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DH19170') HTTP/1.1" 204 0
2026-03-30 11:20:37 [auto1.fr] INFO: Found listing with ID: SY82143
2026-03-30 11:20:37 [auto1.fr] INFO: Found listing with ID: PB24231
2026-03-30 11:20:37 [auto1.fr] INFO: Found listing with ID: LZ43337
2026-03-30 11:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ43337%27 HTTP/1.1" 200 None
2026-03-30 11:20:37 [auto1.fr] INFO: Scrape type for LZ43337: 2
2026-03-30 11:20:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3156631-8bf6-5874-a7ba-7a298691606b with identifier: LZ43337
2026-03-30 11:20:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3156631-8bf6-5874-a7ba-7a298691606b with scrape type 2
2026-03-30 11:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3156631-8bf6-5874-a7ba-7a298691606b with scrape type 2
2026-03-30 11:20:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c3156631-8bf6-5874-a7ba-7a298691606b, identifier: LZ43337
2026-03-30 11:20:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c3156631-8bf6-5874-a7ba-7a298691606b with identifier: LZ43337
2026-03-30 11:20:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c3156631-8bf6-5874-a7ba-7a298691606b with identifier: LZ43337
2026-03-30 11:20:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c3156631-8bf6-5874-a7ba-7a298691606b with identifier: LZ43337 to the API
2026-03-30 11:20:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:20:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:20:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:18:43Z',
'fuel_type': 'diesel',
'id': 'c3156631-8bf6-5874-a7ba-7a298691606b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ43337',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 240282,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-07-31',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.9 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2005}
2026-03-30 11:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ43337%27 HTTP/1.1" 200 None
2026-03-30 11:20:37 [auto1.fr] INFO: Saving data for LZ43337: {'auction_closing_time': 1774970323.0, 'created_time': 1774265097.753535, 'last_price_update_time': 1774869637.94744}
2026-03-30 11:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LZ43337') HTTP/1.1" 204 0
2026-03-30 11:20:38 [auto1.fr] INFO: Found listing with ID: EC47257
2026-03-30 11:20:38 [auto1.fr] INFO: Found listing with ID: FY82549
2026-03-30 11:20:38 [auto1.fr] INFO: Found listing with ID: SF81175
2026-03-30 11:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF81175%27 HTTP/1.1" 200 None
2026-03-30 11:20:38 [auto1.fr] INFO: Scrape type for SF81175: 1
2026-03-30 11:20:38 [auto1.fr] INFO: Found listing with ID: YP51598
2026-03-30 11:20:38 [auto1.fr] INFO: Found listing with ID: MS48505
2026-03-30 11:20:38 [auto1.fr] INFO: Found listing with ID: LA37286
2026-03-30 11:20:38 [auto1.fr] INFO: Found listing with ID: JA87898
2026-03-30 11:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA87898%27 HTTP/1.1" 200 None
2026-03-30 11:20:38 [auto1.fr] INFO: Scrape type for JA87898: 2
2026-03-30 11:20:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9ddfe53-439b-5d85-9f7b-6573cf6f5994 with identifier: JA87898
2026-03-30 11:20:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9ddfe53-439b-5d85-9f7b-6573cf6f5994 with scrape type 2
2026-03-30 11:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9ddfe53-439b-5d85-9f7b-6573cf6f5994 with scrape type 2
2026-03-30 11:20:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e9ddfe53-439b-5d85-9f7b-6573cf6f5994, identifier: JA87898
2026-03-30 11:20:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e9ddfe53-439b-5d85-9f7b-6573cf6f5994 with identifier: JA87898
2026-03-30 11:20:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:20:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 11:20:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:20:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e9ddfe53-439b-5d85-9f7b-6573cf6f5994 with identifier: JA87898
2026-03-30 11:20:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e9ddfe53-439b-5d85-9f7b-6573cf6f5994 with identifier: JA87898 to the API
2026-03-30 11:20:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:20:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:20:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 158,
'expiration_date': '2026-03-31T15:17:03Z',
'fuel_type': 'petrol',
'id': 'e9ddfe53-439b-5d85-9f7b-6573cf6f5994',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA87898',
'listing': 'auction',
'make': 'Renault',
'model': 'Arkana',
'odometer': 49421,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-24',
'seller_name': None,
'title': 'Renault Arkana 1.3 TCe Mild-Hybrid R.S. Line',
'transmission': 'automatic',
'trim': 'R.S. Line',
'year': 2023}
2026-03-30 11:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA87898%27 HTTP/1.1" 200 None
2026-03-30 11:20:38 [auto1.fr] INFO: Saving data for JA87898: {'auction_closing_time': 1774970223.0, 'created_time': 1773745787.564556, 'last_price_update_time': 1774869638.659845}
2026-03-30 11:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JA87898') HTTP/1.1" 204 0
2026-03-30 11:20:38 [auto1.fr] INFO: Found listing with ID: BN65079
2026-03-30 11:20:38 [auto1.fr] INFO: Found listing with ID: FS32024
2026-03-30 11:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS32024%27 HTTP/1.1" 200 None
2026-03-30 11:20:38 [auto1.fr] INFO: Scrape type for FS32024: 2
2026-03-30 11:20:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ab7f11e-32ed-50d6-8802-b953c232cbed with identifier: FS32024
2026-03-30 11:20:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ab7f11e-32ed-50d6-8802-b953c232cbed with scrape type 2
2026-03-30 11:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ab7f11e-32ed-50d6-8802-b953c232cbed with scrape type 2
2026-03-30 11:20:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7ab7f11e-32ed-50d6-8802-b953c232cbed, identifier: FS32024
2026-03-30 11:20:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7ab7f11e-32ed-50d6-8802-b953c232cbed with identifier: FS32024
2026-03-30 11:20:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7ab7f11e-32ed-50d6-8802-b953c232cbed with identifier: FS32024
2026-03-30 11:20:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7ab7f11e-32ed-50d6-8802-b953c232cbed with identifier: FS32024 to the API
2026-03-30 11:20:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:20:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:20:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:56:15Z',
'fuel_type': 'diesel',
'id': '7ab7f11e-32ed-50d6-8802-b953c232cbed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS32024',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 80517,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-12',
'seller_name': None,
'title': 'Peugeot 3008 1.6 HDi Féline',
'transmission': 'manual',
'trim': 'Féline',
'year': 2012}
2026-03-30 11:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS32024%27 HTTP/1.1" 200 None
2026-03-30 11:20:39 [auto1.fr] INFO: Saving data for FS32024: {'auction_closing_time': 1774972575.0, 'created_time': 1774091337.473251, 'last_price_update_time': 1774869639.217326}
2026-03-30 11:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FS32024') HTTP/1.1" 204 0
2026-03-30 11:20:39 [auto1.fr] INFO: Found listing with ID: JH20182
2026-03-30 11:20:39 [auto1.fr] INFO: Found listing with ID: YR96034
2026-03-30 11:20:39 [auto1.fr] INFO: Found listing with ID: CY69551
2026-03-30 11:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY69551%27 HTTP/1.1" 200 None
2026-03-30 11:20:39 [auto1.fr] INFO: Scrape type for CY69551: 1
2026-03-30 11:20:39 [auto1.fr] INFO: Found listing with ID: WM59560
2026-03-30 11:20:39 [auto1.fr] INFO: Found listing with ID: NK23006
2026-03-30 11:20:39 [auto1.fr] INFO: Found listing with ID: PG30087
2026-03-30 11:20:39 [auto1.fr] INFO: Found listing with ID: CC77005
2026-03-30 11:20:39 [auto1.fr] INFO: Found listing with ID: KY97876
2026-03-30 11:20:39 [auto1.fr] INFO: Found listing with ID: GS87587
2026-03-30 11:20:39 [auto1.fr] INFO: Found listing with ID: SC94219
2026-03-30 11:20:39 [auto1.fr] INFO: Found listing with ID: NL15141
2026-03-30 11:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL15141%27 HTTP/1.1" 200 None
2026-03-30 11:20:39 [auto1.fr] INFO: Scrape type for NL15141: 2
2026-03-30 11:20:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 000f1ea8-618a-5b51-86d4-c48ecaad8c6b with identifier: NL15141
2026-03-30 11:20:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 000f1ea8-618a-5b51-86d4-c48ecaad8c6b with scrape type 2
2026-03-30 11:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 000f1ea8-618a-5b51-86d4-c48ecaad8c6b with scrape type 2
2026-03-30 11:20:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 000f1ea8-618a-5b51-86d4-c48ecaad8c6b, identifier: NL15141
2026-03-30 11:20:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 000f1ea8-618a-5b51-86d4-c48ecaad8c6b with identifier: NL15141
2026-03-30 11:20:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 000f1ea8-618a-5b51-86d4-c48ecaad8c6b with identifier: NL15141
2026-03-30 11:20:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 000f1ea8-618a-5b51-86d4-c48ecaad8c6b with identifier: NL15141 to the API
2026-03-30 11:20:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:20:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:20:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:24:29Z',
'fuel_type': 'diesel',
'id': '000f1ea8-618a-5b51-86d4-c48ecaad8c6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL15141',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 113473,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-26',
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2020}
2026-03-30 11:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL15141%27 HTTP/1.1" 200 None
2026-03-30 11:20:39 [auto1.fr] INFO: Saving data for NL15141: {'auction_closing_time': 1774970669.0, 'created_time': 1772609269.82249, 'last_price_update_time': 1774869639.723029}
2026-03-30 11:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NL15141') HTTP/1.1" 204 0
2026-03-30 11:20:39 [auto1.fr] INFO: Found listing with ID: ZN08846
2026-03-30 11:20:39 [auto1.fr] INFO: Found listing with ID: FX85984
2026-03-30 11:20:39 [auto1.fr] INFO: Found listing with ID: RV38404
2026-03-30 11:20:39 [auto1.fr] INFO: Found listing with ID: XJ76593
2026-03-30 11:20:39 [auto1.fr] INFO: Found listing with ID: RU91332
2026-03-30 11:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU91332%27 HTTP/1.1" 200 None
2026-03-30 11:20:39 [auto1.fr] INFO: Scrape type for RU91332: 1
2026-03-30 11:20:39 [auto1.fr] INFO: Found listing with ID: YL76832
2026-03-30 11:20:39 [auto1.fr] INFO: Found listing with ID: DW24154
2026-03-30 11:20:39 [auto1.fr] INFO: Found listing with ID: TS11881
2026-03-30 11:20:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:20:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ65165/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ET54199/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MH50218/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD85936> (referer: https://www.auto1.com/v1/car-details-view/RD85936/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0 with identifier: RD85936
2026-03-30 11:20:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0 with scrape type 1
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F0d%252F900d353a254d34fb6cc2f917446de59e%252Fpa%252FRD85936_ba34b518007d8067a5ccfb6bf84ebc8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_ba34b518007d8067a5ccfb6bf84ebc8b.jpg not downloaded yet
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F0d%252F900d353a254d34fb6cc2f917446de59e%252Fpa%252FRD85936_cc516a295a296375737c728ef481ac26.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_cc516a295a296375737c728ef481ac26.jpg not downloaded yet
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F0d%252F900d353a254d34fb6cc2f917446de59e%252Fpa%252FRD85936_711e4fcb4a5763cd2d3ed32c3b43f5fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_711e4fcb4a5763cd2d3ed32c3b43f5fc.jpg not downloaded yet
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F0d%252F900d353a254d34fb6cc2f917446de59e%252Fpa%252FRD85936_c6dfa7a9dadeed2da3d0501d318ac20e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_c6dfa7a9dadeed2da3d0501d318ac20e.jpg not downloaded yet
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F0d%252F900d353a254d34fb6cc2f917446de59e%252Fpa%252FRD85936_a8ebfd98588fde495774782f8bf7a52c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_a8ebfd98588fde495774782f8bf7a52c.jpg not downloaded yet
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F0d%252F900d353a254d34fb6cc2f917446de59e%252Fpa%252FRD85936_16527550351a07fae33acc104fcee15f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_16527550351a07fae33acc104fcee15f.jpg not downloaded yet
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F0d%252F900d353a254d34fb6cc2f917446de59e%252Fpa%252FRD85936_b80df372ef7b56fd3afb4611c8fcef06.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_b80df372ef7b56fd3afb4611c8fcef06.jpg not downloaded yet
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F0d%252F900d353a254d34fb6cc2f917446de59e%252Fpa%252FRD85936_a1b6e4feb022530fce30056b56fb998f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_a1b6e4feb022530fce30056b56fb998f.jpg not downloaded yet
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F0d%252F900d353a254d34fb6cc2f917446de59e%252Fpa%252FRD85936_2876d0e1b1ed03d1a61c1ee3a2ba95d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_2876d0e1b1ed03d1a61c1ee3a2ba95d6.jpg not downloaded yet
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F0d%252F900d353a254d34fb6cc2f917446de59e%252Fpa%252FRD85936_6126a723e8b10e4724d54db451745107.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_6126a723e8b10e4724d54db451745107.jpg not downloaded yet
2026-03-30 11:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE79976> (referer: https://www.auto1.com/v1/car-details-view/SE79976/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_6126a723e8b10e4724d54db451745107.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d1d145b-2ebf-582d-b577-686b5e431fb1 with identifier: SE79976
2026-03-30 11:20:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d1d145b-2ebf-582d-b577-686b5e431fb1 with scrape type 1
2026-03-30 11:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d1d145b-2ebf-582d-b577-686b5e431fb1
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F26%252F8e2632a4345b0ce2ecc6f3bc78141ae8%252Fpa%252FSE79976_c236dcbf1ec6431a59a0b96222113044.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_c236dcbf1ec6431a59a0b96222113044.jpg not downloaded yet
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F26%252F8e2632a4345b0ce2ecc6f3bc78141ae8%252Fpa%252FSE79976_9cb321505fa2f3f74fb3797bd4592d93.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_9cb321505fa2f3f74fb3797bd4592d93.jpg not downloaded yet
2026-03-30 11:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_2876d0e1b1ed03d1a61c1ee3a2ba95d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F26%252F8e2632a4345b0ce2ecc6f3bc78141ae8%252Fpa%252FSE79976_262b764a376ea55c9a3fcfcb08d7bc1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_262b764a376ea55c9a3fcfcb08d7bc1c.jpg not downloaded yet
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F26%252F8e2632a4345b0ce2ecc6f3bc78141ae8%252Fpa%252FSE79976_0a652fdc6a160513b9fbeba33442cfed.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_0a652fdc6a160513b9fbeba33442cfed.jpg not downloaded yet
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F26%252F8e2632a4345b0ce2ecc6f3bc78141ae8%252Fpa%252FSE79976_c2dec5befb21fe84632e8203d6e22899.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_c2dec5befb21fe84632e8203d6e22899.jpg not downloaded yet
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F26%252F8e2632a4345b0ce2ecc6f3bc78141ae8%252Fpa%252FSE79976_4498b74267a4cd63df4b111bf5c19567.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_4498b74267a4cd63df4b111bf5c19567.jpg not downloaded yet
2026-03-30 11:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385ffcd0>
2026-03-30 11:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0/2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F0d%252F900d353a254d34fb6cc2f917446de59e%252Fpa%252FRD85936_6126a723e8b10e4724d54db451745107.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_6126a723e8b10e4724d54db451745107.jpg saved to cache
2026-03-30 11:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0
2026-03-30 11:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_9cb321505fa2f3f74fb3797bd4592d93.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F26%252F8e2632a4345b0ce2ecc6f3bc78141ae8%252Fpa%252FSE79976_2afad40b77203f8bc5d4a1614e1a8e1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_2afad40b77203f8bc5d4a1614e1a8e1c.jpg not downloaded yet
2026-03-30 11:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383bf710>
2026-03-30 11:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0/2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F0d%252F900d353a254d34fb6cc2f917446de59e%252Fpa%252FRD85936_2876d0e1b1ed03d1a61c1ee3a2ba95d6.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_2876d0e1b1ed03d1a61c1ee3a2ba95d6.jpg saved to cache
2026-03-30 11:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F26%252F8e2632a4345b0ce2ecc6f3bc78141ae8%252Fpa%252FSE79976_d89fc77af15da6e4e8373b42a2bd8796.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_d89fc77af15da6e4e8373b42a2bd8796.jpg not downloaded yet
2026-03-30 11:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F26%252F8e2632a4345b0ce2ecc6f3bc78141ae8%252Fpa%252FSE79976_26c3d3b73c16704cec9610d23c3e5fc6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_26c3d3b73c16704cec9610d23c3e5fc6.jpg not downloaded yet
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F26%252F8e2632a4345b0ce2ecc6f3bc78141ae8%252Fpa%252FSE79976_a3fa6033aeab715e138bdd176fc6b846.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_a3fa6033aeab715e138bdd176fc6b846.jpg not downloaded yet
2026-03-30 11:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_4498b74267a4cd63df4b111bf5c19567.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738705010>
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1d145b-2ebf-582d-b577-686b5e431fb1/8d1d145b-2ebf-582d-b577-686b5e431fb1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F26%252F8e2632a4345b0ce2ecc6f3bc78141ae8%252Fpa%252FSE79976_9cb321505fa2f3f74fb3797bd4592d93.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_9cb321505fa2f3f74fb3797bd4592d93.jpg saved to cache
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d1d145b-2ebf-582d-b577-686b5e431fb1
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738686310>
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1d145b-2ebf-582d-b577-686b5e431fb1/8d1d145b-2ebf-582d-b577-686b5e431fb1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F26%252F8e2632a4345b0ce2ecc6f3bc78141ae8%252Fpa%252FSE79976_4498b74267a4cd63df4b111bf5c19567.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_4498b74267a4cd63df4b111bf5c19567.jpg saved to cache
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d1d145b-2ebf-582d-b577-686b5e431fb1
2026-03-30 11:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_a3fa6033aeab715e138bdd176fc6b846.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_26c3d3b73c16704cec9610d23c3e5fc6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_d89fc77af15da6e4e8373b42a2bd8796.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738789690>
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1d145b-2ebf-582d-b577-686b5e431fb1/8d1d145b-2ebf-582d-b577-686b5e431fb1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F26%252F8e2632a4345b0ce2ecc6f3bc78141ae8%252Fpa%252FSE79976_a3fa6033aeab715e138bdd176fc6b846.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_a3fa6033aeab715e138bdd176fc6b846.jpg saved to cache
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d1d145b-2ebf-582d-b577-686b5e431fb1
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385311d0>
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1d145b-2ebf-582d-b577-686b5e431fb1/8d1d145b-2ebf-582d-b577-686b5e431fb1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F26%252F8e2632a4345b0ce2ecc6f3bc78141ae8%252Fpa%252FSE79976_26c3d3b73c16704cec9610d23c3e5fc6.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_26c3d3b73c16704cec9610d23c3e5fc6.jpg saved to cache
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d1d145b-2ebf-582d-b577-686b5e431fb1
2026-03-30 11:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_2afad40b77203f8bc5d4a1614e1a8e1c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383bfd50>
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1d145b-2ebf-582d-b577-686b5e431fb1/8d1d145b-2ebf-582d-b577-686b5e431fb1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F26%252F8e2632a4345b0ce2ecc6f3bc78141ae8%252Fpa%252FSE79976_d89fc77af15da6e4e8373b42a2bd8796.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_d89fc77af15da6e4e8373b42a2bd8796.jpg saved to cache
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d1d145b-2ebf-582d-b577-686b5e431fb1
2026-03-30 11:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_c2dec5befb21fe84632e8203d6e22899.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738455550>
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1d145b-2ebf-582d-b577-686b5e431fb1/8d1d145b-2ebf-582d-b577-686b5e431fb1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F26%252F8e2632a4345b0ce2ecc6f3bc78141ae8%252Fpa%252FSE79976_2afad40b77203f8bc5d4a1614e1a8e1c.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_2afad40b77203f8bc5d4a1614e1a8e1c.jpg saved to cache
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d1d145b-2ebf-582d-b577-686b5e431fb1
2026-03-30 11:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_0a652fdc6a160513b9fbeba33442cfed.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383d1990>
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1d145b-2ebf-582d-b577-686b5e431fb1/8d1d145b-2ebf-582d-b577-686b5e431fb1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F26%252F8e2632a4345b0ce2ecc6f3bc78141ae8%252Fpa%252FSE79976_c2dec5befb21fe84632e8203d6e22899.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_c2dec5befb21fe84632e8203d6e22899.jpg saved to cache
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d1d145b-2ebf-582d-b577-686b5e431fb1
2026-03-30 11:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_262b764a376ea55c9a3fcfcb08d7bc1c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738563d10>
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1d145b-2ebf-582d-b577-686b5e431fb1/8d1d145b-2ebf-582d-b577-686b5e431fb1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F26%252F8e2632a4345b0ce2ecc6f3bc78141ae8%252Fpa%252FSE79976_0a652fdc6a160513b9fbeba33442cfed.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_0a652fdc6a160513b9fbeba33442cfed.jpg saved to cache
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d1d145b-2ebf-582d-b577-686b5e431fb1
2026-03-30 11:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_c236dcbf1ec6431a59a0b96222113044.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738465150>
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1d145b-2ebf-582d-b577-686b5e431fb1/8d1d145b-2ebf-582d-b577-686b5e431fb1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F26%252F8e2632a4345b0ce2ecc6f3bc78141ae8%252Fpa%252FSE79976_262b764a376ea55c9a3fcfcb08d7bc1c.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_262b764a376ea55c9a3fcfcb08d7bc1c.jpg saved to cache
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d1d145b-2ebf-582d-b577-686b5e431fb1
2026-03-30 11:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_a1b6e4feb022530fce30056b56fb998f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZL96278> (referer: https://www.auto1.com/v1/car-details-view/ZL96278/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738562050>
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1d145b-2ebf-582d-b577-686b5e431fb1/8d1d145b-2ebf-582d-b577-686b5e431fb1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F26%252F8e2632a4345b0ce2ecc6f3bc78141ae8%252Fpa%252FSE79976_c236dcbf1ec6431a59a0b96222113044.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_c236dcbf1ec6431a59a0b96222113044.jpg saved to cache
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d1d145b-2ebf-582d-b577-686b5e431fb1
2026-03-30 11:20:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d1d145b-2ebf-582d-b577-686b5e431fb1, skipping ID generation
2026-03-30 11:20:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d1d145b-2ebf-582d-b577-686b5e431fb1 with scrape type 1
2026-03-30 11:20:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d1d145b-2ebf-582d-b577-686b5e431fb1 sending to next pipeline
2026-03-30 11:20:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8d1d145b-2ebf-582d-b577-686b5e431fb1, identifier: SE79976
2026-03-30 11:20:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_16527550351a07fae33acc104fcee15f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_b80df372ef7b56fd3afb4611c8fcef06.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8d1d145b-2ebf-582d-b577-686b5e431fb1 with identifier: SE79976
2026-03-30 11:20:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8d1d145b-2ebf-582d-b577-686b5e431fb1 with identifier: SE79976
2026-03-30 11:20:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8d1d145b-2ebf-582d-b577-686b5e431fb1 with identifier: SE79976 to the API
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:20:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_c236dcbf1ec6431a59a0b96222113044.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '0.9L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:58:22Z',
'fuel_type': 'petrol',
'id': '8d1d145b-2ebf-582d-b577-686b5e431fb1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE79976',
'listing': 'auction',
'location': 'FR',
'make': 'Renault',
'model': 'Clio',
'odometer': 144824,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1d145b-2ebf-582d-b577-686b5e431fb1/8d1d145b-2ebf-582d-b577-686b5e431fb1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60106,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_c236dcbf1ec6431a59a0b96222113044.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1d145b-2ebf-582d-b577-686b5e431fb1/8d1d145b-2ebf-582d-b577-686b5e431fb1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60383,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_9cb321505fa2f3f74fb3797bd4592d93.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1d145b-2ebf-582d-b577-686b5e431fb1/8d1d145b-2ebf-582d-b577-686b5e431fb1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_262b764a376ea55c9a3fcfcb08d7bc1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1d145b-2ebf-582d-b577-686b5e431fb1/8d1d145b-2ebf-582d-b577-686b5e431fb1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49880,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_0a652fdc6a160513b9fbeba33442cfed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1d145b-2ebf-582d-b577-686b5e431fb1/8d1d145b-2ebf-582d-b577-686b5e431fb1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57980,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_c2dec5befb21fe84632e8203d6e22899.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1d145b-2ebf-582d-b577-686b5e431fb1/8d1d145b-2ebf-582d-b577-686b5e431fb1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59407,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_4498b74267a4cd63df4b111bf5c19567.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1d145b-2ebf-582d-b577-686b5e431fb1/8d1d145b-2ebf-582d-b577-686b5e431fb1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_2afad40b77203f8bc5d4a1614e1a8e1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1d145b-2ebf-582d-b577-686b5e431fb1/8d1d145b-2ebf-582d-b577-686b5e431fb1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123815,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_d89fc77af15da6e4e8373b42a2bd8796.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1d145b-2ebf-582d-b577-686b5e431fb1/8d1d145b-2ebf-582d-b577-686b5e431fb1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62215,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_26c3d3b73c16704cec9610d23c3e5fc6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1d145b-2ebf-582d-b577-686b5e431fb1/8d1d145b-2ebf-582d-b577-686b5e431fb1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/26/8e2632a4345b0ce2ecc6f3bc78141ae8/pa/SE79976_a3fa6033aeab715e138bdd176fc6b846.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-07-05',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 0.9 Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2015}
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE79976%27 HTTP/1.1" 200 None
2026-03-30 11:20:58 [auto1.fr] INFO: Saving data for SE79976: {'created_time': 1774869658.709201, 'last_price_update_time': 1774869658.709213, 'auction_closing_time': 1774972702.0}
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SE79976') HTTP/1.1" 204 0
2026-03-30 11:20:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385edcd0>
2026-03-30 11:20:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0/2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F0d%252F900d353a254d34fb6cc2f917446de59e%252Fpa%252FRD85936_a1b6e4feb022530fce30056b56fb998f.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_a1b6e4feb022530fce30056b56fb998f.jpg saved to cache
2026-03-30 11:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0
2026-03-30 11:20:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 823d946c-4991-5318-a5fa-b95d64076bcf with identifier: ZL96278
2026-03-30 11:20:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 823d946c-4991-5318-a5fa-b95d64076bcf with scrape type 1
2026-03-30 11:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 823d946c-4991-5318-a5fa-b95d64076bcf
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F35%252F1335947ec8e88a790c383efc971b0be6%252Fpa%252FZL96278_8692b12dc0a06723842c4f6d538ae000.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_8692b12dc0a06723842c4f6d538ae000.jpg already downloaded
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F35%252F1335947ec8e88a790c383efc971b0be6%252Fpa%252FZL96278_069aff28d54a4895771fdddbad9729fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_069aff28d54a4895771fdddbad9729fd.jpg already downloaded
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F35%252F1335947ec8e88a790c383efc971b0be6%252Fpa%252FZL96278_7dc903106f8416424bfaeda0da3d0ff8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_7dc903106f8416424bfaeda0da3d0ff8.jpg already downloaded
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F35%252F1335947ec8e88a790c383efc971b0be6%252Fpa%252FZL96278_121f1d1d8fa658acc06bb5ec173b893c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_121f1d1d8fa658acc06bb5ec173b893c.jpg already downloaded
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F35%252F1335947ec8e88a790c383efc971b0be6%252Fpa%252FZL96278_d768d2aac6722d55f83a1d228c58128e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_d768d2aac6722d55f83a1d228c58128e.jpg already downloaded
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F35%252F1335947ec8e88a790c383efc971b0be6%252Fpa%252FZL96278_24738448c038f5f644b773db2cadd6b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_24738448c038f5f644b773db2cadd6b0.jpg already downloaded
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F35%252F1335947ec8e88a790c383efc971b0be6%252Fpa%252FZL96278_e9eb2781356afeb145358a9fbf7825a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_e9eb2781356afeb145358a9fbf7825a4.jpg already downloaded
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F35%252F1335947ec8e88a790c383efc971b0be6%252Fpa%252FZL96278_5c7b447d46102b63a861fb7eb2fa036b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_5c7b447d46102b63a861fb7eb2fa036b.jpg already downloaded
2026-03-30 11:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F35%252F1335947ec8e88a790c383efc971b0be6%252Fpa%252FZL96278_ced4ef08e424b7ef5af82a5a0b210da3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_ced4ef08e424b7ef5af82a5a0b210da3.jpg already downloaded
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F35%252F1335947ec8e88a790c383efc971b0be6%252Fpa%252FZL96278_0bd6cae3ac7b4ba38501d8777c76ab5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_0bd6cae3ac7b4ba38501d8777c76ab5d.jpg already downloaded
2026-03-30 11:20:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 823d946c-4991-5318-a5fa-b95d64076bcf, identifier: ZL96278
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738711690>
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0/2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F0d%252F900d353a254d34fb6cc2f917446de59e%252Fpa%252FRD85936_16527550351a07fae33acc104fcee15f.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_16527550351a07fae33acc104fcee15f.jpg saved to cache
2026-03-30 11:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738780050>
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0/2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F0d%252F900d353a254d34fb6cc2f917446de59e%252Fpa%252FRD85936_b80df372ef7b56fd3afb4611c8fcef06.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_b80df372ef7b56fd3afb4611c8fcef06.jpg saved to cache
2026-03-30 11:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0
2026-03-30 11:20:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 823d946c-4991-5318-a5fa-b95d64076bcf with identifier: ZL96278
2026-03-30 11:20:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 823d946c-4991-5318-a5fa-b95d64076bcf with identifier: ZL96278
2026-03-30 11:20:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 823d946c-4991-5318-a5fa-b95d64076bcf with identifier: ZL96278 to the API
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:20:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZL96278>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2026-03-31T15:51:36Z',
'fuel_type': 'diesel',
'id': '823d946c-4991-5318-a5fa-b95d64076bcf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL96278',
'listing': 'auction',
'location': 'FR, Tarnos',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 105047,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_8692b12dc0a06723842c4f6d538ae000.jpg',
'https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_069aff28d54a4895771fdddbad9729fd.jpg',
'https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_7dc903106f8416424bfaeda0da3d0ff8.jpg',
'https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_121f1d1d8fa658acc06bb5ec173b893c.jpg',
'https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_d768d2aac6722d55f83a1d228c58128e.jpg',
'https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_24738448c038f5f644b773db2cadd6b0.jpg',
'https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_e9eb2781356afeb145358a9fbf7825a4.jpg',
'https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_5c7b447d46102b63a861fb7eb2fa036b.jpg',
'https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_ced4ef08e424b7ef5af82a5a0b210da3.jpg',
'https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_0bd6cae3ac7b4ba38501d8777c76ab5d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823d946c-4991-5318-a5fa-b95d64076bcf/823d946c-4991-5318-a5fa-b95d64076bcf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83827,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_8692b12dc0a06723842c4f6d538ae000.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823d946c-4991-5318-a5fa-b95d64076bcf/823d946c-4991-5318-a5fa-b95d64076bcf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_069aff28d54a4895771fdddbad9729fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823d946c-4991-5318-a5fa-b95d64076bcf/823d946c-4991-5318-a5fa-b95d64076bcf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_7dc903106f8416424bfaeda0da3d0ff8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823d946c-4991-5318-a5fa-b95d64076bcf/823d946c-4991-5318-a5fa-b95d64076bcf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_121f1d1d8fa658acc06bb5ec173b893c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823d946c-4991-5318-a5fa-b95d64076bcf/823d946c-4991-5318-a5fa-b95d64076bcf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73676,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_d768d2aac6722d55f83a1d228c58128e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823d946c-4991-5318-a5fa-b95d64076bcf/823d946c-4991-5318-a5fa-b95d64076bcf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3078785,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_24738448c038f5f644b773db2cadd6b0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823d946c-4991-5318-a5fa-b95d64076bcf/823d946c-4991-5318-a5fa-b95d64076bcf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_e9eb2781356afeb145358a9fbf7825a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823d946c-4991-5318-a5fa-b95d64076bcf/823d946c-4991-5318-a5fa-b95d64076bcf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81066,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_5c7b447d46102b63a861fb7eb2fa036b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823d946c-4991-5318-a5fa-b95d64076bcf/823d946c-4991-5318-a5fa-b95d64076bcf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_ced4ef08e424b7ef5af82a5a0b210da3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823d946c-4991-5318-a5fa-b95d64076bcf/823d946c-4991-5318-a5fa-b95d64076bcf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/35/1335947ec8e88a790c383efc971b0be6/pa/ZL96278_0bd6cae3ac7b4ba38501d8777c76ab5d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-05-19',
'seats_number': 7,
'seller_name': None,
'title': 'Land Rover Discovery Sport 2.0 Td4 HSE',
'transmission': 'manual',
'trim': 'HSE',
'year': 2016}
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZL96278%27 HTTP/1.1" 200 None
2026-03-30 11:20:59 [auto1.fr] INFO: Saving data for ZL96278: {'created_time': 1774869659.622514, 'last_price_update_time': 1774869659.622526, 'auction_closing_time': 1774972296.0}
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZL96278') HTTP/1.1" 204 0
2026-03-30 11:20:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_a8ebfd98588fde495774782f8bf7a52c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_c6dfa7a9dadeed2da3d0501d318ac20e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_711e4fcb4a5763cd2d3ed32c3b43f5fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_cc516a295a296375737c728ef481ac26.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a8f8210>
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0/2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F0d%252F900d353a254d34fb6cc2f917446de59e%252Fpa%252FRD85936_a8ebfd98588fde495774782f8bf7a52c.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_a8ebfd98588fde495774782f8bf7a52c.jpg saved to cache
2026-03-30 11:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738687cd0>
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0/2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F0d%252F900d353a254d34fb6cc2f917446de59e%252Fpa%252FRD85936_c6dfa7a9dadeed2da3d0501d318ac20e.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_c6dfa7a9dadeed2da3d0501d318ac20e.jpg saved to cache
2026-03-30 11:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0
2026-03-30 11:20:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_ba34b518007d8067a5ccfb6bf84ebc8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a4b3b10>
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0/2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F0d%252F900d353a254d34fb6cc2f917446de59e%252Fpa%252FRD85936_711e4fcb4a5763cd2d3ed32c3b43f5fc.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_711e4fcb4a5763cd2d3ed32c3b43f5fc.jpg saved to cache
2026-03-30 11:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383b1890>
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0/2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F0d%252F900d353a254d34fb6cc2f917446de59e%252Fpa%252FRD85936_cc516a295a296375737c728ef481ac26.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_cc516a295a296375737c728ef481ac26.jpg saved to cache
2026-03-30 11:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738554850>
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0/2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F0d%252F900d353a254d34fb6cc2f917446de59e%252Fpa%252FRD85936_ba34b518007d8067a5ccfb6bf84ebc8b.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_ba34b518007d8067a5ccfb6bf84ebc8b.jpg saved to cache
2026-03-30 11:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0
2026-03-30 11:20:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0, skipping ID generation
2026-03-30 11:20:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0 with scrape type 1
2026-03-30 11:20:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0 sending to next pipeline
2026-03-30 11:21:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0, identifier: RD85936
2026-03-30 11:21:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0 with identifier: RD85936
2026-03-30 11:21:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0 with identifier: RD85936
2026-03-30 11:21:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0 with identifier: RD85936 to the API
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:21:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_ba34b518007d8067a5ccfb6bf84ebc8b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:56:41Z',
'fuel_type': 'diesel',
'id': '2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD85936',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Citroen',
'model': 'C5 Aircross',
'odometer': 195776,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0/2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47314,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_ba34b518007d8067a5ccfb6bf84ebc8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0/2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93246,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_cc516a295a296375737c728ef481ac26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0/2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45275,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_711e4fcb4a5763cd2d3ed32c3b43f5fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0/2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_c6dfa7a9dadeed2da3d0501d318ac20e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0/2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43387,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_a8ebfd98588fde495774782f8bf7a52c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0/2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47862,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_16527550351a07fae33acc104fcee15f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0/2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_b80df372ef7b56fd3afb4611c8fcef06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0/2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108152,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_a1b6e4feb022530fce30056b56fb998f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0/2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68982,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_2876d0e1b1ed03d1a61c1ee3a2ba95d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0/2acb05b4-5518-5bc3-a8f3-a1ef2ea593b0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60218,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/0d/900d353a254d34fb6cc2f917446de59e/pa/RD85936_6126a723e8b10e4724d54db451745107.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-26',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C5 Aircross 1.5 Blue-HDi Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2019}
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD85936%27 HTTP/1.1" 200 None
2026-03-30 11:21:00 [auto1.fr] INFO: Saving data for RD85936: {'created_time': 1774869660.511898, 'last_price_update_time': 1774869660.511908, 'auction_closing_time': 1774972601.0}
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RD85936') HTTP/1.1" 204 0
2026-03-30 11:21:05 [scrapy.extensions.logstats] INFO: Crawled 147 pages (at 17 pages/min), scraped 126 items (at 12 items/min)
2026-03-30 11:21:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:21:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC74188/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.728(s), this was the 1st time calling it.
2026-03-30 11:21:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.462314463990812 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:21:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WX18382> (referer: https://www.auto1.com/v1/car-details-view/WX18382/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fd8813f-a70e-581d-8b03-c72daf7be198 with identifier: WX18382
2026-03-30 11:21:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fd8813f-a70e-581d-8b03-c72daf7be198 with scrape type 1
2026-03-30 11:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 6fd8813f-a70e-581d-8b03-c72daf7be198
2026-03-30 11:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F50%252F7a5060fe11fb1a394bd7c06a367508ce%252Fpa%252FWX18382_53a0d8567e02b03574a13f2b056a4e5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_53a0d8567e02b03574a13f2b056a4e5a.jpg not downloaded yet
2026-03-30 11:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F50%252F7a5060fe11fb1a394bd7c06a367508ce%252Fpa%252FWX18382_8c7ab8fdbed02404b7089b6c7c1880a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_8c7ab8fdbed02404b7089b6c7c1880a8.jpg not downloaded yet
2026-03-30 11:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F50%252F7a5060fe11fb1a394bd7c06a367508ce%252Fpa%252FWX18382_e3484882507d3381e620d45821e54d0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_e3484882507d3381e620d45821e54d0f.jpg not downloaded yet
2026-03-30 11:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F50%252F7a5060fe11fb1a394bd7c06a367508ce%252Fpa%252FWX18382_cd3f4876a8f78317a867bf86e4a25e27.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_cd3f4876a8f78317a867bf86e4a25e27.jpg not downloaded yet
2026-03-30 11:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F50%252F7a5060fe11fb1a394bd7c06a367508ce%252Fpa%252FWX18382_74a5344b283c098fb569a116b0628be3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_74a5344b283c098fb569a116b0628be3.jpg not downloaded yet
2026-03-30 11:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F50%252F7a5060fe11fb1a394bd7c06a367508ce%252Fpa%252FWX18382_0f03ea5981ef819a34935a18381ac54b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_0f03ea5981ef819a34935a18381ac54b.jpg not downloaded yet
2026-03-30 11:21:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LT10059> (referer: https://www.auto1.com/v1/car-details-view/LT10059/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_0f03ea5981ef819a34935a18381ac54b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 721fc3fa-8771-5899-a7b3-609cd46967f7 with identifier: LT10059
2026-03-30 11:21:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 721fc3fa-8771-5899-a7b3-609cd46967f7 with scrape type 1
2026-03-30 11:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 721fc3fa-8771-5899-a7b3-609cd46967f7
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fdf%252F17df0720c0b6d164d2c4f89f43ee471e%252Fpa%252FLT10059_27dfe336024ac3b6463ffd51109c5fbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_27dfe336024ac3b6463ffd51109c5fbb.jpg already downloaded
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fdf%252F17df0720c0b6d164d2c4f89f43ee471e%252Fpa%252FLT10059_d6935e7f2809538a41f432f17baaa1c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_d6935e7f2809538a41f432f17baaa1c6.jpg already downloaded
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fdf%252F17df0720c0b6d164d2c4f89f43ee471e%252Fpa%252FLT10059_db43f3489f3e7673cba74a4c06c3e0bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_db43f3489f3e7673cba74a4c06c3e0bc.jpg already downloaded
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fdf%252F17df0720c0b6d164d2c4f89f43ee471e%252Fpa%252FLT10059_52cacb59d730d0cf8ff68487ba075df5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_52cacb59d730d0cf8ff68487ba075df5.jpg already downloaded
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fdf%252F17df0720c0b6d164d2c4f89f43ee471e%252Fpa%252FLT10059_ab29181fc28766aafbc06b1ba5ff77f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_ab29181fc28766aafbc06b1ba5ff77f4.jpg already downloaded
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fdf%252F17df0720c0b6d164d2c4f89f43ee471e%252Fpa%252FLT10059_6ecd6de70138686a4b5090efd8cadc8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_6ecd6de70138686a4b5090efd8cadc8d.jpg already downloaded
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fdf%252F17df0720c0b6d164d2c4f89f43ee471e%252Fpa%252FLT10059_a716fb6579e19d6f56c09d3cf83799e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_a716fb6579e19d6f56c09d3cf83799e9.jpg already downloaded
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fdf%252F17df0720c0b6d164d2c4f89f43ee471e%252Fpa%252FLT10059_44dad8983877c84f42836959fb4a4c4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_44dad8983877c84f42836959fb4a4c4a.jpg already downloaded
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fdf%252F17df0720c0b6d164d2c4f89f43ee471e%252Fpa%252FLT10059_55af1724fe98aef30078376246d1f8e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_55af1724fe98aef30078376246d1f8e3.jpg already downloaded
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fdf%252F17df0720c0b6d164d2c4f89f43ee471e%252Fpa%252FLT10059_422d583eb7091317ccd01bd3cb0c1423.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_422d583eb7091317ccd01bd3cb0c1423.jpg already downloaded
2026-03-30 11:21:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 721fc3fa-8771-5899-a7b3-609cd46967f7, identifier: LT10059
2026-03-30 11:21:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 721fc3fa-8771-5899-a7b3-609cd46967f7 with identifier: LT10059
2026-03-30 11:21:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 721fc3fa-8771-5899-a7b3-609cd46967f7 with identifier: LT10059
2026-03-30 11:21:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 721fc3fa-8771-5899-a7b3-609cd46967f7 with identifier: LT10059 to the API
2026-03-30 11:21:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:21:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:21:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LT10059>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:00:01Z',
'fuel_type': 'diesel',
'id': '721fc3fa-8771-5899-a7b3-609cd46967f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT10059',
'listing': 'auction',
'location': 'FR, CASTELNAU D’ESTRETEFONDS',
'make': 'Peugeot',
'model': '308',
'odometer': 252648,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_27dfe336024ac3b6463ffd51109c5fbb.jpg',
'https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_d6935e7f2809538a41f432f17baaa1c6.jpg',
'https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_db43f3489f3e7673cba74a4c06c3e0bc.jpg',
'https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_52cacb59d730d0cf8ff68487ba075df5.jpg',
'https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_ab29181fc28766aafbc06b1ba5ff77f4.jpg',
'https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_6ecd6de70138686a4b5090efd8cadc8d.jpg',
'https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_a716fb6579e19d6f56c09d3cf83799e9.jpg',
'https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_44dad8983877c84f42836959fb4a4c4a.jpg',
'https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_55af1724fe98aef30078376246d1f8e3.jpg',
'https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_422d583eb7091317ccd01bd3cb0c1423.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721fc3fa-8771-5899-a7b3-609cd46967f7/721fc3fa-8771-5899-a7b3-609cd46967f7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81582,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_27dfe336024ac3b6463ffd51109c5fbb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721fc3fa-8771-5899-a7b3-609cd46967f7/721fc3fa-8771-5899-a7b3-609cd46967f7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74506,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_d6935e7f2809538a41f432f17baaa1c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721fc3fa-8771-5899-a7b3-609cd46967f7/721fc3fa-8771-5899-a7b3-609cd46967f7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70002,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_db43f3489f3e7673cba74a4c06c3e0bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721fc3fa-8771-5899-a7b3-609cd46967f7/721fc3fa-8771-5899-a7b3-609cd46967f7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54907,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_52cacb59d730d0cf8ff68487ba075df5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721fc3fa-8771-5899-a7b3-609cd46967f7/721fc3fa-8771-5899-a7b3-609cd46967f7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78740,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_ab29181fc28766aafbc06b1ba5ff77f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721fc3fa-8771-5899-a7b3-609cd46967f7/721fc3fa-8771-5899-a7b3-609cd46967f7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74766,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_6ecd6de70138686a4b5090efd8cadc8d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721fc3fa-8771-5899-a7b3-609cd46967f7/721fc3fa-8771-5899-a7b3-609cd46967f7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73734,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_a716fb6579e19d6f56c09d3cf83799e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721fc3fa-8771-5899-a7b3-609cd46967f7/721fc3fa-8771-5899-a7b3-609cd46967f7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89651,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_44dad8983877c84f42836959fb4a4c4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721fc3fa-8771-5899-a7b3-609cd46967f7/721fc3fa-8771-5899-a7b3-609cd46967f7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_55af1724fe98aef30078376246d1f8e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721fc3fa-8771-5899-a7b3-609cd46967f7/721fc3fa-8771-5899-a7b3-609cd46967f7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/df/17df0720c0b6d164d2c4f89f43ee471e/pa/LT10059_422d583eb7091317ccd01bd3cb0c1423.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-12-18',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2017}
2026-03-30 11:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT10059%27 HTTP/1.1" 200 None
2026-03-30 11:21:25 [auto1.fr] INFO: Saving data for LT10059: {'created_time': 1774869685.003416, 'last_price_update_time': 1774869685.003427, 'auction_closing_time': 1774969201.0}
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LT10059') HTTP/1.1" 204 0
2026-03-30 11:21:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_74a5344b283c098fb569a116b0628be3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0739412410>
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd8813f-a70e-581d-8b03-c72daf7be198/6fd8813f-a70e-581d-8b03-c72daf7be198_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F50%252F7a5060fe11fb1a394bd7c06a367508ce%252Fpa%252FWX18382_0f03ea5981ef819a34935a18381ac54b.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_0f03ea5981ef819a34935a18381ac54b.jpg saved to cache
2026-03-30 11:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6fd8813f-a70e-581d-8b03-c72daf7be198
2026-03-30 11:21:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385543d0>
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd8813f-a70e-581d-8b03-c72daf7be198/6fd8813f-a70e-581d-8b03-c72daf7be198_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F50%252F7a5060fe11fb1a394bd7c06a367508ce%252Fpa%252FWX18382_74a5344b283c098fb569a116b0628be3.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_74a5344b283c098fb569a116b0628be3.jpg saved to cache
2026-03-30 11:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6fd8813f-a70e-581d-8b03-c72daf7be198
2026-03-30 11:21:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_cd3f4876a8f78317a867bf86e4a25e27.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_e3484882507d3381e620d45821e54d0f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738587b50>
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd8813f-a70e-581d-8b03-c72daf7be198/6fd8813f-a70e-581d-8b03-c72daf7be198_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F50%252F7a5060fe11fb1a394bd7c06a367508ce%252Fpa%252FWX18382_cd3f4876a8f78317a867bf86e4a25e27.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_cd3f4876a8f78317a867bf86e4a25e27.jpg saved to cache
2026-03-30 11:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6fd8813f-a70e-581d-8b03-c72daf7be198
2026-03-30 11:21:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_8c7ab8fdbed02404b7089b6c7c1880a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385345d0>
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd8813f-a70e-581d-8b03-c72daf7be198/6fd8813f-a70e-581d-8b03-c72daf7be198_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F50%252F7a5060fe11fb1a394bd7c06a367508ce%252Fpa%252FWX18382_e3484882507d3381e620d45821e54d0f.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_e3484882507d3381e620d45821e54d0f.jpg saved to cache
2026-03-30 11:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6fd8813f-a70e-581d-8b03-c72daf7be198
2026-03-30 11:21:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_53a0d8567e02b03574a13f2b056a4e5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738707550>
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd8813f-a70e-581d-8b03-c72daf7be198/6fd8813f-a70e-581d-8b03-c72daf7be198_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F50%252F7a5060fe11fb1a394bd7c06a367508ce%252Fpa%252FWX18382_8c7ab8fdbed02404b7089b6c7c1880a8.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_8c7ab8fdbed02404b7089b6c7c1880a8.jpg saved to cache
2026-03-30 11:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6fd8813f-a70e-581d-8b03-c72daf7be198
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a7fa1d0>
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd8813f-a70e-581d-8b03-c72daf7be198/6fd8813f-a70e-581d-8b03-c72daf7be198_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F50%252F7a5060fe11fb1a394bd7c06a367508ce%252Fpa%252FWX18382_53a0d8567e02b03574a13f2b056a4e5a.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_53a0d8567e02b03574a13f2b056a4e5a.jpg saved to cache
2026-03-30 11:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6fd8813f-a70e-581d-8b03-c72daf7be198
2026-03-30 11:21:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6fd8813f-a70e-581d-8b03-c72daf7be198, skipping ID generation
2026-03-30 11:21:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fd8813f-a70e-581d-8b03-c72daf7be198 with scrape type 1
2026-03-30 11:21:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6fd8813f-a70e-581d-8b03-c72daf7be198 sending to next pipeline
2026-03-30 11:21:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6fd8813f-a70e-581d-8b03-c72daf7be198, identifier: WX18382
2026-03-30 11:21:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6fd8813f-a70e-581d-8b03-c72daf7be198 with identifier: WX18382
2026-03-30 11:21:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6fd8813f-a70e-581d-8b03-c72daf7be198 with identifier: WX18382
2026-03-30 11:21:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6fd8813f-a70e-581d-8b03-c72daf7be198 with identifier: WX18382 to the API
2026-03-30 11:21:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:21:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:21:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_53a0d8567e02b03574a13f2b056a4e5a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 141,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:01:02Z',
'fuel_type': 'diesel',
'id': '6fd8813f-a70e-581d-8b03-c72daf7be198',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX18382',
'listing': 'auction',
'location': 'FR, Saint-Etienne',
'make': 'Fiat',
'model': 'Panda',
'odometer': 196491,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd8813f-a70e-581d-8b03-c72daf7be198/6fd8813f-a70e-581d-8b03-c72daf7be198_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_53a0d8567e02b03574a13f2b056a4e5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd8813f-a70e-581d-8b03-c72daf7be198/6fd8813f-a70e-581d-8b03-c72daf7be198_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81533,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_8c7ab8fdbed02404b7089b6c7c1880a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd8813f-a70e-581d-8b03-c72daf7be198/6fd8813f-a70e-581d-8b03-c72daf7be198_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_e3484882507d3381e620d45821e54d0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd8813f-a70e-581d-8b03-c72daf7be198/6fd8813f-a70e-581d-8b03-c72daf7be198_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52478,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_cd3f4876a8f78317a867bf86e4a25e27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd8813f-a70e-581d-8b03-c72daf7be198/6fd8813f-a70e-581d-8b03-c72daf7be198_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 135215,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_74a5344b283c098fb569a116b0628be3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd8813f-a70e-581d-8b03-c72daf7be198/6fd8813f-a70e-581d-8b03-c72daf7be198_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66493,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/50/7a5060fe11fb1a394bd7c06a367508ce/pa/WX18382_0f03ea5981ef819a34935a18381ac54b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-05-17',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat Panda 1.3 JTD Cross 4x4',
'transmission': 'manual',
'trim': 'Cross 4x4',
'year': 2006}
2026-03-30 11:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX18382%27 HTTP/1.1" 200 None
2026-03-30 11:21:26 [auto1.fr] INFO: Saving data for WX18382: {'created_time': 1774869686.666327, 'last_price_update_time': 1774869686.66634, 'auction_closing_time': 1774969262.0}
2026-03-30 11:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WX18382') HTTP/1.1" 204 0
2026-03-30 11:21:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BC58235> (referer: https://www.auto1.com/v1/car-details-view/BC58235/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU91332/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3149ace-cc20-5414-8b0a-6be0f11b6611 with identifier: BC58235
2026-03-30 11:21:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3149ace-cc20-5414-8b0a-6be0f11b6611 with scrape type 1
2026-03-30 11:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e3149ace-cc20-5414-8b0a-6be0f11b6611
2026-03-30 11:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F06%252Fe106dbf1c2c4c6c8ec6a02b6c67e2c55%252Fpa%252FBC58235_62e29e3e064eb206c169bab8ada581a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/06/e106dbf1c2c4c6c8ec6a02b6c67e2c55/pa/BC58235_62e29e3e064eb206c169bab8ada581a1.jpg already downloaded
2026-03-30 11:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F06%252Fe106dbf1c2c4c6c8ec6a02b6c67e2c55%252Fpa%252FBC58235_f1f434ae586287bfcf53ead90f3fbee8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/06/e106dbf1c2c4c6c8ec6a02b6c67e2c55/pa/BC58235_f1f434ae586287bfcf53ead90f3fbee8.jpg already downloaded
2026-03-30 11:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F06%252Fe106dbf1c2c4c6c8ec6a02b6c67e2c55%252Fpa%252FBC58235_3837112b97f84ce478be93752f2a96a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/06/e106dbf1c2c4c6c8ec6a02b6c67e2c55/pa/BC58235_3837112b97f84ce478be93752f2a96a1.jpg already downloaded
2026-03-30 11:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F06%252Fe106dbf1c2c4c6c8ec6a02b6c67e2c55%252Fpa%252FBC58235_ed79c11d7d3914a68686da6057accba6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/06/e106dbf1c2c4c6c8ec6a02b6c67e2c55/pa/BC58235_ed79c11d7d3914a68686da6057accba6.jpg already downloaded
2026-03-30 11:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F06%252Fe106dbf1c2c4c6c8ec6a02b6c67e2c55%252Fpa%252FBC58235_48c26f422db97df2bac038165dc705d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/06/e106dbf1c2c4c6c8ec6a02b6c67e2c55/pa/BC58235_48c26f422db97df2bac038165dc705d8.jpg already downloaded
2026-03-30 11:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F06%252Fe106dbf1c2c4c6c8ec6a02b6c67e2c55%252Fpa%252FBC58235_442b960403f6525d841a8f68601a5c1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/06/e106dbf1c2c4c6c8ec6a02b6c67e2c55/pa/BC58235_442b960403f6525d841a8f68601a5c1b.jpg already downloaded
2026-03-30 11:21:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e3149ace-cc20-5414-8b0a-6be0f11b6611, identifier: BC58235
2026-03-30 11:21:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e3149ace-cc20-5414-8b0a-6be0f11b6611 with identifier: BC58235
2026-03-30 11:21:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e3149ace-cc20-5414-8b0a-6be0f11b6611 with identifier: BC58235
2026-03-30 11:21:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e3149ace-cc20-5414-8b0a-6be0f11b6611 with identifier: BC58235 to the API
2026-03-30 11:21:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:21:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:21:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BC58235>
{'auction_title': '',
'c_o_2_emission_value': 85,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:44:01Z',
'fuel_type': 'diesel',
'id': 'e3149ace-cc20-5414-8b0a-6be0f11b6611',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC58235',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Peugeot',
'model': '308',
'odometer': 282695,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imge1/06/e106dbf1c2c4c6c8ec6a02b6c67e2c55/pa/BC58235_62e29e3e064eb206c169bab8ada581a1.jpg',
'https://img-pa.auto1.com/imge1/06/e106dbf1c2c4c6c8ec6a02b6c67e2c55/pa/BC58235_f1f434ae586287bfcf53ead90f3fbee8.jpg',
'https://img-pa.auto1.com/imge1/06/e106dbf1c2c4c6c8ec6a02b6c67e2c55/pa/BC58235_3837112b97f84ce478be93752f2a96a1.jpg',
'https://img-pa.auto1.com/imge1/06/e106dbf1c2c4c6c8ec6a02b6c67e2c55/pa/BC58235_ed79c11d7d3914a68686da6057accba6.jpg',
'https://img-pa.auto1.com/imge1/06/e106dbf1c2c4c6c8ec6a02b6c67e2c55/pa/BC58235_48c26f422db97df2bac038165dc705d8.jpg',
'https://img-pa.auto1.com/imge1/06/e106dbf1c2c4c6c8ec6a02b6c67e2c55/pa/BC58235_442b960403f6525d841a8f68601a5c1b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3149ace-cc20-5414-8b0a-6be0f11b6611/e3149ace-cc20-5414-8b0a-6be0f11b6611_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74115,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/06/e106dbf1c2c4c6c8ec6a02b6c67e2c55/pa/BC58235_62e29e3e064eb206c169bab8ada581a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3149ace-cc20-5414-8b0a-6be0f11b6611/e3149ace-cc20-5414-8b0a-6be0f11b6611_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72087,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/06/e106dbf1c2c4c6c8ec6a02b6c67e2c55/pa/BC58235_f1f434ae586287bfcf53ead90f3fbee8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3149ace-cc20-5414-8b0a-6be0f11b6611/e3149ace-cc20-5414-8b0a-6be0f11b6611_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/06/e106dbf1c2c4c6c8ec6a02b6c67e2c55/pa/BC58235_3837112b97f84ce478be93752f2a96a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3149ace-cc20-5414-8b0a-6be0f11b6611/e3149ace-cc20-5414-8b0a-6be0f11b6611_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/06/e106dbf1c2c4c6c8ec6a02b6c67e2c55/pa/BC58235_ed79c11d7d3914a68686da6057accba6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3149ace-cc20-5414-8b0a-6be0f11b6611/e3149ace-cc20-5414-8b0a-6be0f11b6611_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/06/e106dbf1c2c4c6c8ec6a02b6c67e2c55/pa/BC58235_48c26f422db97df2bac038165dc705d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3149ace-cc20-5414-8b0a-6be0f11b6611/e3149ace-cc20-5414-8b0a-6be0f11b6611_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40749,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/06/e106dbf1c2c4c6c8ec6a02b6c67e2c55/pa/BC58235_442b960403f6525d841a8f68601a5c1b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-10-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 Blue-HDi Business-Line',
'transmission': 'manual',
'trim': 'Business-Line',
'year': 2014}
2026-03-30 11:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC58235%27 HTTP/1.1" 200 None
2026-03-30 11:21:27 [auto1.fr] INFO: Saving data for BC58235: {'created_time': 1774869687.583275, 'last_price_update_time': 1774869687.583286, 'auction_closing_time': 1774971841.0}
2026-03-30 11:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BC58235') HTTP/1.1" 204 0
2026-03-30 11:21:31 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.439(s), this was the 1st time calling it.
2026-03-30 11:21:31 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.422147638407796 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:21:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:21:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA42500/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ65165> (referer: https://www.auto1.com/v1/car-details-view/WJ65165/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c38dc92b-7396-5f86-9d4f-0d386fb303be with identifier: WJ65165
2026-03-30 11:21:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c38dc92b-7396-5f86-9d4f-0d386fb303be with scrape type 1
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c38dc92b-7396-5f86-9d4f-0d386fb303be
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F44%252Fbe44389f4e37d426ad1469e8da8e8780%252Fpa%252FWJ65165_5f14c6179b5382331b7a6cb8daf864ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_5f14c6179b5382331b7a6cb8daf864ef.jpg already downloaded
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F44%252Fbe44389f4e37d426ad1469e8da8e8780%252Fpa%252FWJ65165_016664742b1c54d91168bc8a7cba149f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_016664742b1c54d91168bc8a7cba149f.jpg already downloaded
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F44%252Fbe44389f4e37d426ad1469e8da8e8780%252Fpa%252FWJ65165_1039d9221a2b6cae8994c83bb6fa69a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_1039d9221a2b6cae8994c83bb6fa69a6.jpg already downloaded
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F44%252Fbe44389f4e37d426ad1469e8da8e8780%252Fpa%252FWJ65165_17ff1911f319050ee636781dbbaf7fb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_17ff1911f319050ee636781dbbaf7fb0.jpg already downloaded
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F44%252Fbe44389f4e37d426ad1469e8da8e8780%252Fpa%252FWJ65165_2b903e2131abe8a7e378cca1a80000ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_2b903e2131abe8a7e378cca1a80000ef.jpg already downloaded
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F44%252Fbe44389f4e37d426ad1469e8da8e8780%252Fpa%252FWJ65165_b5cdcd677fe4b24350e09850d9658aaf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_b5cdcd677fe4b24350e09850d9658aaf.jpg already downloaded
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F44%252Fbe44389f4e37d426ad1469e8da8e8780%252Fpa%252FWJ65165_b60ab254b28dfdff80057baa23067c53.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_b60ab254b28dfdff80057baa23067c53.jpg already downloaded
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F44%252Fbe44389f4e37d426ad1469e8da8e8780%252Fpa%252FWJ65165_522ee70f5e9494f671bbd3e88a1baefb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_522ee70f5e9494f671bbd3e88a1baefb.jpg already downloaded
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F44%252Fbe44389f4e37d426ad1469e8da8e8780%252Fpa%252FWJ65165_eba16ff16449d14e419d53353b0b82dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_eba16ff16449d14e419d53353b0b82dd.jpg already downloaded
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F44%252Fbe44389f4e37d426ad1469e8da8e8780%252Fpa%252FWJ65165_f89f24ddd471edb0afae1e91d57b34b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_f89f24ddd471edb0afae1e91d57b34b5.jpg already downloaded
2026-03-30 11:21:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c38dc92b-7396-5f86-9d4f-0d386fb303be, identifier: WJ65165
2026-03-30 11:21:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c38dc92b-7396-5f86-9d4f-0d386fb303be with identifier: WJ65165
2026-03-30 11:21:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c38dc92b-7396-5f86-9d4f-0d386fb303be with identifier: WJ65165
2026-03-30 11:21:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c38dc92b-7396-5f86-9d4f-0d386fb303be with identifier: WJ65165 to the API
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:21:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WJ65165>
{'auction_title': '',
'c_o_2_emission_value': 101,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:59:31Z',
'fuel_type': 'petrol',
'id': 'c38dc92b-7396-5f86-9d4f-0d386fb303be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ65165',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 95724,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_5f14c6179b5382331b7a6cb8daf864ef.jpg',
'https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_016664742b1c54d91168bc8a7cba149f.jpg',
'https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_1039d9221a2b6cae8994c83bb6fa69a6.jpg',
'https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_17ff1911f319050ee636781dbbaf7fb0.jpg',
'https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_2b903e2131abe8a7e378cca1a80000ef.jpg',
'https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_b5cdcd677fe4b24350e09850d9658aaf.jpg',
'https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_b60ab254b28dfdff80057baa23067c53.jpg',
'https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_522ee70f5e9494f671bbd3e88a1baefb.jpg',
'https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_eba16ff16449d14e419d53353b0b82dd.jpg',
'https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_f89f24ddd471edb0afae1e91d57b34b5.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38dc92b-7396-5f86-9d4f-0d386fb303be/c38dc92b-7396-5f86-9d4f-0d386fb303be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_5f14c6179b5382331b7a6cb8daf864ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38dc92b-7396-5f86-9d4f-0d386fb303be/c38dc92b-7396-5f86-9d4f-0d386fb303be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59456,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_016664742b1c54d91168bc8a7cba149f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38dc92b-7396-5f86-9d4f-0d386fb303be/c38dc92b-7396-5f86-9d4f-0d386fb303be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52614,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_1039d9221a2b6cae8994c83bb6fa69a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38dc92b-7396-5f86-9d4f-0d386fb303be/c38dc92b-7396-5f86-9d4f-0d386fb303be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57669,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_17ff1911f319050ee636781dbbaf7fb0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38dc92b-7396-5f86-9d4f-0d386fb303be/c38dc92b-7396-5f86-9d4f-0d386fb303be_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_2b903e2131abe8a7e378cca1a80000ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38dc92b-7396-5f86-9d4f-0d386fb303be/c38dc92b-7396-5f86-9d4f-0d386fb303be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61716,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_b5cdcd677fe4b24350e09850d9658aaf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38dc92b-7396-5f86-9d4f-0d386fb303be/c38dc92b-7396-5f86-9d4f-0d386fb303be_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_b60ab254b28dfdff80057baa23067c53.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38dc92b-7396-5f86-9d4f-0d386fb303be/c38dc92b-7396-5f86-9d4f-0d386fb303be_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62678,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_522ee70f5e9494f671bbd3e88a1baefb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38dc92b-7396-5f86-9d4f-0d386fb303be/c38dc92b-7396-5f86-9d4f-0d386fb303be_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60846,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_eba16ff16449d14e419d53353b0b82dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38dc92b-7396-5f86-9d4f-0d386fb303be/c38dc92b-7396-5f86-9d4f-0d386fb303be_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57962,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/44/be44389f4e37d426ad1469e8da8e8780/pa/WJ65165_f89f24ddd471edb0afae1e91d57b34b5.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-17',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2019}
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ65165%27 HTTP/1.1" 200 None
2026-03-30 11:21:47 [auto1.fr] INFO: Saving data for WJ65165: {'created_time': 1774869707.49118, 'last_price_update_time': 1774869707.491193, 'auction_closing_time': 1774972771.0}
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WJ65165') HTTP/1.1" 204 0
2026-03-30 11:21:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF42565> (referer: https://www.auto1.com/v1/car-details-view/AF42565/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3762526-f5ac-5e79-899b-0674f9018766 with identifier: AF42565
2026-03-30 11:21:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3762526-f5ac-5e79-899b-0674f9018766 with scrape type 1
2026-03-30 11:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b3762526-f5ac-5e79-899b-0674f9018766
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F23%252Fe8232920253403e0f7597cf019698dec%252Fpa%252FAF42565_5f127fc7d56916491ed9542ded56b634.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/23/e8232920253403e0f7597cf019698dec/pa/AF42565_5f127fc7d56916491ed9542ded56b634.jpg already downloaded
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F23%252Fe8232920253403e0f7597cf019698dec%252Fpa%252FAF42565_b956a96cc0544a4bb783bcf0a6922c73.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/23/e8232920253403e0f7597cf019698dec/pa/AF42565_b956a96cc0544a4bb783bcf0a6922c73.jpg already downloaded
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F23%252Fe8232920253403e0f7597cf019698dec%252Fpa%252FAF42565_35479f4599b0ac83afac886337cabfd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/23/e8232920253403e0f7597cf019698dec/pa/AF42565_35479f4599b0ac83afac886337cabfd3.jpg already downloaded
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F23%252Fe8232920253403e0f7597cf019698dec%252Fpa%252FAF42565_d524946b8a2163f16dd669e8971cc9db.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/23/e8232920253403e0f7597cf019698dec/pa/AF42565_d524946b8a2163f16dd669e8971cc9db.jpg already downloaded
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F23%252Fe8232920253403e0f7597cf019698dec%252Fpa%252FAF42565_2119cc35934b1cfb5dcc8ba613922a86.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/23/e8232920253403e0f7597cf019698dec/pa/AF42565_2119cc35934b1cfb5dcc8ba613922a86.jpg already downloaded
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F23%252Fe8232920253403e0f7597cf019698dec%252Fpa%252FAF42565_36dc1b9e2cbf12fe6726cdf0ca7f4721.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/23/e8232920253403e0f7597cf019698dec/pa/AF42565_36dc1b9e2cbf12fe6726cdf0ca7f4721.jpg already downloaded
2026-03-30 11:21:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b3762526-f5ac-5e79-899b-0674f9018766, identifier: AF42565
2026-03-30 11:21:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b3762526-f5ac-5e79-899b-0674f9018766 with identifier: AF42565
2026-03-30 11:21:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b3762526-f5ac-5e79-899b-0674f9018766 with identifier: AF42565
2026-03-30 11:21:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b3762526-f5ac-5e79-899b-0674f9018766 with identifier: AF42565 to the API
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:21:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AF42565>
{'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.3L',
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:36:07Z',
'fuel_type': 'petrol',
'id': 'b3762526-f5ac-5e79-899b-0674f9018766',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF42565',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 156268,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imge8/23/e8232920253403e0f7597cf019698dec/pa/AF42565_5f127fc7d56916491ed9542ded56b634.jpg',
'https://img-pa.auto1.com/imge8/23/e8232920253403e0f7597cf019698dec/pa/AF42565_b956a96cc0544a4bb783bcf0a6922c73.jpg',
'https://img-pa.auto1.com/imge8/23/e8232920253403e0f7597cf019698dec/pa/AF42565_35479f4599b0ac83afac886337cabfd3.jpg',
'https://img-pa.auto1.com/imge8/23/e8232920253403e0f7597cf019698dec/pa/AF42565_d524946b8a2163f16dd669e8971cc9db.jpg',
'https://img-pa.auto1.com/imge8/23/e8232920253403e0f7597cf019698dec/pa/AF42565_2119cc35934b1cfb5dcc8ba613922a86.jpg',
'https://img-pa.auto1.com/imge8/23/e8232920253403e0f7597cf019698dec/pa/AF42565_36dc1b9e2cbf12fe6726cdf0ca7f4721.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3762526-f5ac-5e79-899b-0674f9018766/b3762526-f5ac-5e79-899b-0674f9018766_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82125,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/23/e8232920253403e0f7597cf019698dec/pa/AF42565_5f127fc7d56916491ed9542ded56b634.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3762526-f5ac-5e79-899b-0674f9018766/b3762526-f5ac-5e79-899b-0674f9018766_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75223,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/23/e8232920253403e0f7597cf019698dec/pa/AF42565_b956a96cc0544a4bb783bcf0a6922c73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3762526-f5ac-5e79-899b-0674f9018766/b3762526-f5ac-5e79-899b-0674f9018766_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77181,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/23/e8232920253403e0f7597cf019698dec/pa/AF42565_35479f4599b0ac83afac886337cabfd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3762526-f5ac-5e79-899b-0674f9018766/b3762526-f5ac-5e79-899b-0674f9018766_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/23/e8232920253403e0f7597cf019698dec/pa/AF42565_d524946b8a2163f16dd669e8971cc9db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3762526-f5ac-5e79-899b-0674f9018766/b3762526-f5ac-5e79-899b-0674f9018766_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113747,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/23/e8232920253403e0f7597cf019698dec/pa/AF42565_2119cc35934b1cfb5dcc8ba613922a86.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3762526-f5ac-5e79-899b-0674f9018766/b3762526-f5ac-5e79-899b-0674f9018766_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70144,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/23/e8232920253403e0f7597cf019698dec/pa/AF42565_36dc1b9e2cbf12fe6726cdf0ca7f4721.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-07-02',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.3 Fun',
'transmission': 'manual',
'trim': 'Fun',
'year': 2007}
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF42565%27 HTTP/1.1" 200 None
2026-03-30 11:21:48 [auto1.fr] INFO: Saving data for AF42565: {'created_time': 1774869708.212185, 'last_price_update_time': 1774869708.212201, 'auction_closing_time': 1774971367.0}
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AF42565') HTTP/1.1" 204 0
2026-03-30 11:21:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY69551/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.443(s), this was the 1st time calling it.
2026-03-30 11:21:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.0781877314868975 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:21:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SF81175/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC74188> (referer: https://www.auto1.com/v1/car-details-view/JC74188/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db670a4c-f7b9-51f4-9c2f-f21b8ed56271 with identifier: JC74188
2026-03-30 11:21:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db670a4c-f7b9-51f4-9c2f-f21b8ed56271 with scrape type 1
2026-03-30 11:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db670a4c-f7b9-51f4-9c2f-f21b8ed56271
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F85%252Fa485751728b4c1fdb8e2cefaa12bc92a%252Fpa%252FJC74188_fd9b4c1db5327c732d0d60274fe589dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_fd9b4c1db5327c732d0d60274fe589dd.jpg not downloaded yet
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F85%252Fa485751728b4c1fdb8e2cefaa12bc92a%252Fpa%252FJC74188_42293c0d9be9c6e1a43dab4b5bfa0a1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_42293c0d9be9c6e1a43dab4b5bfa0a1b.jpg not downloaded yet
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F85%252Fa485751728b4c1fdb8e2cefaa12bc92a%252Fpa%252FJC74188_1353355697e7077c802402da2e9bfd1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_1353355697e7077c802402da2e9bfd1a.jpg not downloaded yet
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F85%252Fa485751728b4c1fdb8e2cefaa12bc92a%252Fpa%252FJC74188_36f4dea6b3a730bd620ef8eb02992c70.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_36f4dea6b3a730bd620ef8eb02992c70.jpg not downloaded yet
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F85%252Fa485751728b4c1fdb8e2cefaa12bc92a%252Fpa%252FJC74188_fd93923e36e5d9fd62afc3e6554fddac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_fd93923e36e5d9fd62afc3e6554fddac.jpg not downloaded yet
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F85%252Fa485751728b4c1fdb8e2cefaa12bc92a%252Fpa%252FJC74188_c02e901d5e9932caecf437b7cab32196.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_c02e901d5e9932caecf437b7cab32196.jpg not downloaded yet
2026-03-30 11:21:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_fd9b4c1db5327c732d0d60274fe589dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_42293c0d9be9c6e1a43dab4b5bfa0a1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F85%252Fa485751728b4c1fdb8e2cefaa12bc92a%252Fpa%252FJC74188_62f719003887917e93cef1a18b9fdf96.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_62f719003887917e93cef1a18b9fdf96.jpg not downloaded yet
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F85%252Fa485751728b4c1fdb8e2cefaa12bc92a%252Fpa%252FJC74188_8bfc0a6f041465769a64aed0f8580fc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_8bfc0a6f041465769a64aed0f8580fc7.jpg not downloaded yet
2026-03-30 11:21:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_1353355697e7077c802402da2e9bfd1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F85%252Fa485751728b4c1fdb8e2cefaa12bc92a%252Fpa%252FJC74188_3f22a8a36565b7825c38af295169494f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_3f22a8a36565b7825c38af295169494f.jpg not downloaded yet
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F85%252Fa485751728b4c1fdb8e2cefaa12bc92a%252Fpa%252FJC74188_4e54fd898287b56f7d7978fefcb4c469.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_4e54fd898287b56f7d7978fefcb4c469.jpg not downloaded yet
2026-03-30 11:21:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_c02e901d5e9932caecf437b7cab32196.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073859fcd0>
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db670a4c-f7b9-51f4-9c2f-f21b8ed56271/db670a4c-f7b9-51f4-9c2f-f21b8ed56271_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F85%252Fa485751728b4c1fdb8e2cefaa12bc92a%252Fpa%252FJC74188_fd9b4c1db5327c732d0d60274fe589dd.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_fd9b4c1db5327c732d0d60274fe589dd.jpg saved to cache
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db670a4c-f7b9-51f4-9c2f-f21b8ed56271
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384d2dd0>
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db670a4c-f7b9-51f4-9c2f-f21b8ed56271/db670a4c-f7b9-51f4-9c2f-f21b8ed56271_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F85%252Fa485751728b4c1fdb8e2cefaa12bc92a%252Fpa%252FJC74188_42293c0d9be9c6e1a43dab4b5bfa0a1b.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_42293c0d9be9c6e1a43dab4b5bfa0a1b.jpg saved to cache
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db670a4c-f7b9-51f4-9c2f-f21b8ed56271
2026-03-30 11:21:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_8bfc0a6f041465769a64aed0f8580fc7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_3f22a8a36565b7825c38af295169494f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073871e910>
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db670a4c-f7b9-51f4-9c2f-f21b8ed56271/db670a4c-f7b9-51f4-9c2f-f21b8ed56271_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F85%252Fa485751728b4c1fdb8e2cefaa12bc92a%252Fpa%252FJC74188_1353355697e7077c802402da2e9bfd1a.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_1353355697e7077c802402da2e9bfd1a.jpg saved to cache
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db670a4c-f7b9-51f4-9c2f-f21b8ed56271
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0739412350>
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db670a4c-f7b9-51f4-9c2f-f21b8ed56271/db670a4c-f7b9-51f4-9c2f-f21b8ed56271_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F85%252Fa485751728b4c1fdb8e2cefaa12bc92a%252Fpa%252FJC74188_c02e901d5e9932caecf437b7cab32196.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_c02e901d5e9932caecf437b7cab32196.jpg saved to cache
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db670a4c-f7b9-51f4-9c2f-f21b8ed56271
2026-03-30 11:21:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_36f4dea6b3a730bd620ef8eb02992c70.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_4e54fd898287b56f7d7978fefcb4c469.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_62f719003887917e93cef1a18b9fdf96.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MH50218> (referer: https://www.auto1.com/v1/car-details-view/MH50218/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_fd93923e36e5d9fd62afc3e6554fddac.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384a1a50>
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db670a4c-f7b9-51f4-9c2f-f21b8ed56271/db670a4c-f7b9-51f4-9c2f-f21b8ed56271_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F85%252Fa485751728b4c1fdb8e2cefaa12bc92a%252Fpa%252FJC74188_8bfc0a6f041465769a64aed0f8580fc7.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_8bfc0a6f041465769a64aed0f8580fc7.jpg saved to cache
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db670a4c-f7b9-51f4-9c2f-f21b8ed56271
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738686b90>
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db670a4c-f7b9-51f4-9c2f-f21b8ed56271/db670a4c-f7b9-51f4-9c2f-f21b8ed56271_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F85%252Fa485751728b4c1fdb8e2cefaa12bc92a%252Fpa%252FJC74188_3f22a8a36565b7825c38af295169494f.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_3f22a8a36565b7825c38af295169494f.jpg saved to cache
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db670a4c-f7b9-51f4-9c2f-f21b8ed56271
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073859ef10>
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db670a4c-f7b9-51f4-9c2f-f21b8ed56271/db670a4c-f7b9-51f4-9c2f-f21b8ed56271_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F85%252Fa485751728b4c1fdb8e2cefaa12bc92a%252Fpa%252FJC74188_36f4dea6b3a730bd620ef8eb02992c70.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_36f4dea6b3a730bd620ef8eb02992c70.jpg saved to cache
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db670a4c-f7b9-51f4-9c2f-f21b8ed56271
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384c1410>
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db670a4c-f7b9-51f4-9c2f-f21b8ed56271/db670a4c-f7b9-51f4-9c2f-f21b8ed56271_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F85%252Fa485751728b4c1fdb8e2cefaa12bc92a%252Fpa%252FJC74188_4e54fd898287b56f7d7978fefcb4c469.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_4e54fd898287b56f7d7978fefcb4c469.jpg saved to cache
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db670a4c-f7b9-51f4-9c2f-f21b8ed56271
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073860bc90>
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db670a4c-f7b9-51f4-9c2f-f21b8ed56271/db670a4c-f7b9-51f4-9c2f-f21b8ed56271_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F85%252Fa485751728b4c1fdb8e2cefaa12bc92a%252Fpa%252FJC74188_62f719003887917e93cef1a18b9fdf96.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_62f719003887917e93cef1a18b9fdf96.jpg saved to cache
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db670a4c-f7b9-51f4-9c2f-f21b8ed56271
2026-03-30 11:21:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1d7b834-ea6d-50fa-9c09-6e768a328fa6 with identifier: MH50218
2026-03-30 11:21:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1d7b834-ea6d-50fa-9c09-6e768a328fa6 with scrape type 1
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f1d7b834-ea6d-50fa-9c09-6e768a328fa6
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fae%252F7bae8879c885836d3f1070edb96a141c%252Fpa%252FMH50218_784e3b02cc0addef20a856aaf4cdbaa8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_784e3b02cc0addef20a856aaf4cdbaa8.jpg not downloaded yet
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fae%252F7bae8879c885836d3f1070edb96a141c%252Fpa%252FMH50218_7446235bcf55d9e915b2216a49d1652a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_7446235bcf55d9e915b2216a49d1652a.jpg not downloaded yet
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fae%252F7bae8879c885836d3f1070edb96a141c%252Fpa%252FMH50218_66597453830275e78e1e6fc06f5da82a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_66597453830275e78e1e6fc06f5da82a.jpg not downloaded yet
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384d5690>
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db670a4c-f7b9-51f4-9c2f-f21b8ed56271/db670a4c-f7b9-51f4-9c2f-f21b8ed56271_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F85%252Fa485751728b4c1fdb8e2cefaa12bc92a%252Fpa%252FJC74188_fd93923e36e5d9fd62afc3e6554fddac.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_fd93923e36e5d9fd62afc3e6554fddac.jpg saved to cache
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db670a4c-f7b9-51f4-9c2f-f21b8ed56271
2026-03-30 11:21:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db670a4c-f7b9-51f4-9c2f-f21b8ed56271, skipping ID generation
2026-03-30 11:21:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db670a4c-f7b9-51f4-9c2f-f21b8ed56271 with scrape type 1
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db670a4c-f7b9-51f4-9c2f-f21b8ed56271 sending to next pipeline
2026-03-30 11:21:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: db670a4c-f7b9-51f4-9c2f-f21b8ed56271, identifier: JC74188
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fae%252F7bae8879c885836d3f1070edb96a141c%252Fpa%252FMH50218_35a4e0081bf1e175b5041173539e1f03.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_35a4e0081bf1e175b5041173539e1f03.jpg not downloaded yet
2026-03-30 11:21:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: db670a4c-f7b9-51f4-9c2f-f21b8ed56271 with identifier: JC74188
2026-03-30 11:21:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: db670a4c-f7b9-51f4-9c2f-f21b8ed56271 with identifier: JC74188
2026-03-30 11:21:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: db670a4c-f7b9-51f4-9c2f-f21b8ed56271 with identifier: JC74188 to the API
2026-03-30 11:21:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:21:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_fd93923e36e5d9fd62afc3e6554fddac.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.7L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:21:35Z',
'fuel_type': 'diesel',
'id': 'db670a4c-f7b9-51f4-9c2f-f21b8ed56271',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC74188',
'listing': 'auction',
'location': 'FR, Saint-Eloi',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 128117,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db670a4c-f7b9-51f4-9c2f-f21b8ed56271/db670a4c-f7b9-51f4-9c2f-f21b8ed56271_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_fd9b4c1db5327c732d0d60274fe589dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db670a4c-f7b9-51f4-9c2f-f21b8ed56271/db670a4c-f7b9-51f4-9c2f-f21b8ed56271_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82664,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_42293c0d9be9c6e1a43dab4b5bfa0a1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db670a4c-f7b9-51f4-9c2f-f21b8ed56271/db670a4c-f7b9-51f4-9c2f-f21b8ed56271_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78387,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_1353355697e7077c802402da2e9bfd1a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db670a4c-f7b9-51f4-9c2f-f21b8ed56271/db670a4c-f7b9-51f4-9c2f-f21b8ed56271_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74070,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_36f4dea6b3a730bd620ef8eb02992c70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db670a4c-f7b9-51f4-9c2f-f21b8ed56271/db670a4c-f7b9-51f4-9c2f-f21b8ed56271_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_fd93923e36e5d9fd62afc3e6554fddac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db670a4c-f7b9-51f4-9c2f-f21b8ed56271/db670a4c-f7b9-51f4-9c2f-f21b8ed56271_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_c02e901d5e9932caecf437b7cab32196.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db670a4c-f7b9-51f4-9c2f-f21b8ed56271/db670a4c-f7b9-51f4-9c2f-f21b8ed56271_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72041,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_62f719003887917e93cef1a18b9fdf96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db670a4c-f7b9-51f4-9c2f-f21b8ed56271/db670a4c-f7b9-51f4-9c2f-f21b8ed56271_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83898,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_8bfc0a6f041465769a64aed0f8580fc7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db670a4c-f7b9-51f4-9c2f-f21b8ed56271/db670a4c-f7b9-51f4-9c2f-f21b8ed56271_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_3f22a8a36565b7825c38af295169494f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db670a4c-f7b9-51f4-9c2f-f21b8ed56271/db670a4c-f7b9-51f4-9c2f-f21b8ed56271_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50708,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/85/a485751728b4c1fdb8e2cefaa12bc92a/pa/JC74188_4e54fd898287b56f7d7978fefcb4c469.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-02',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.7 CRDi Executive 2WD',
'transmission': 'automatic',
'trim': 'Executive 2WD',
'year': 2018}
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC74188%27 HTTP/1.1" 200 None
2026-03-30 11:21:54 [auto1.fr] INFO: Saving data for JC74188: {'created_time': 1774869714.299535, 'last_price_update_time': 1774869714.299547, 'auction_closing_time': 1774970495.0}
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JC74188') HTTP/1.1" 204 0
2026-03-30 11:21:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_784e3b02cc0addef20a856aaf4cdbaa8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fae%252F7bae8879c885836d3f1070edb96a141c%252Fpa%252FMH50218_472365d27db0ee8fe9904b927cbd2a7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_472365d27db0ee8fe9904b927cbd2a7f.jpg not downloaded yet
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fae%252F7bae8879c885836d3f1070edb96a141c%252Fpa%252FMH50218_4409b490d8dd608bf11bc7f2d357cbe0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_4409b490d8dd608bf11bc7f2d357cbe0.jpg not downloaded yet
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fae%252F7bae8879c885836d3f1070edb96a141c%252Fpa%252FMH50218_fe52c0a252125cfc3cc6550ba76c1393.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_fe52c0a252125cfc3cc6550ba76c1393.jpg not downloaded yet
2026-03-30 11:21:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_66597453830275e78e1e6fc06f5da82a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fae%252F7bae8879c885836d3f1070edb96a141c%252Fpa%252FMH50218_010f64ec5a10518f53eaa4b7b9f2b88a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_010f64ec5a10518f53eaa4b7b9f2b88a.jpg not downloaded yet
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fae%252F7bae8879c885836d3f1070edb96a141c%252Fpa%252FMH50218_525e45ad62decf17c9e05ee858444851.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_525e45ad62decf17c9e05ee858444851.jpg not downloaded yet
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fae%252F7bae8879c885836d3f1070edb96a141c%252Fpa%252FMH50218_92353713ea8b5d95ce4a4236b6da413e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_92353713ea8b5d95ce4a4236b6da413e.jpg not downloaded yet
2026-03-30 11:21:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_35a4e0081bf1e175b5041173539e1f03.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_472365d27db0ee8fe9904b927cbd2a7f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383f0210>
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1d7b834-ea6d-50fa-9c09-6e768a328fa6/f1d7b834-ea6d-50fa-9c09-6e768a328fa6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fae%252F7bae8879c885836d3f1070edb96a141c%252Fpa%252FMH50218_784e3b02cc0addef20a856aaf4cdbaa8.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_784e3b02cc0addef20a856aaf4cdbaa8.jpg saved to cache
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f1d7b834-ea6d-50fa-9c09-6e768a328fa6
2026-03-30 11:21:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_fe52c0a252125cfc3cc6550ba76c1393.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_7446235bcf55d9e915b2216a49d1652a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384ebb50>
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1d7b834-ea6d-50fa-9c09-6e768a328fa6/f1d7b834-ea6d-50fa-9c09-6e768a328fa6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fae%252F7bae8879c885836d3f1070edb96a141c%252Fpa%252FMH50218_66597453830275e78e1e6fc06f5da82a.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_66597453830275e78e1e6fc06f5da82a.jpg saved to cache
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f1d7b834-ea6d-50fa-9c09-6e768a328fa6
2026-03-30 11:21:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_525e45ad62decf17c9e05ee858444851.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383f3e50>
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1d7b834-ea6d-50fa-9c09-6e768a328fa6/f1d7b834-ea6d-50fa-9c09-6e768a328fa6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fae%252F7bae8879c885836d3f1070edb96a141c%252Fpa%252FMH50218_35a4e0081bf1e175b5041173539e1f03.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_35a4e0081bf1e175b5041173539e1f03.jpg saved to cache
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f1d7b834-ea6d-50fa-9c09-6e768a328fa6
2026-03-30 11:21:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_4409b490d8dd608bf11bc7f2d357cbe0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384e82d0>
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1d7b834-ea6d-50fa-9c09-6e768a328fa6/f1d7b834-ea6d-50fa-9c09-6e768a328fa6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fae%252F7bae8879c885836d3f1070edb96a141c%252Fpa%252FMH50218_472365d27db0ee8fe9904b927cbd2a7f.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_472365d27db0ee8fe9904b927cbd2a7f.jpg saved to cache
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f1d7b834-ea6d-50fa-9c09-6e768a328fa6
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384b8810>
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1d7b834-ea6d-50fa-9c09-6e768a328fa6/f1d7b834-ea6d-50fa-9c09-6e768a328fa6_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fae%252F7bae8879c885836d3f1070edb96a141c%252Fpa%252FMH50218_fe52c0a252125cfc3cc6550ba76c1393.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_fe52c0a252125cfc3cc6550ba76c1393.jpg saved to cache
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f1d7b834-ea6d-50fa-9c09-6e768a328fa6
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385dfe10>
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1d7b834-ea6d-50fa-9c09-6e768a328fa6/f1d7b834-ea6d-50fa-9c09-6e768a328fa6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fae%252F7bae8879c885836d3f1070edb96a141c%252Fpa%252FMH50218_7446235bcf55d9e915b2216a49d1652a.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_7446235bcf55d9e915b2216a49d1652a.jpg saved to cache
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f1d7b834-ea6d-50fa-9c09-6e768a328fa6
2026-03-30 11:21:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_010f64ec5a10518f53eaa4b7b9f2b88a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_92353713ea8b5d95ce4a4236b6da413e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738561390>
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1d7b834-ea6d-50fa-9c09-6e768a328fa6/f1d7b834-ea6d-50fa-9c09-6e768a328fa6_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fae%252F7bae8879c885836d3f1070edb96a141c%252Fpa%252FMH50218_525e45ad62decf17c9e05ee858444851.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_525e45ad62decf17c9e05ee858444851.jpg saved to cache
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f1d7b834-ea6d-50fa-9c09-6e768a328fa6
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383c6310>
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1d7b834-ea6d-50fa-9c09-6e768a328fa6/f1d7b834-ea6d-50fa-9c09-6e768a328fa6_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fae%252F7bae8879c885836d3f1070edb96a141c%252Fpa%252FMH50218_4409b490d8dd608bf11bc7f2d357cbe0.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_4409b490d8dd608bf11bc7f2d357cbe0.jpg saved to cache
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f1d7b834-ea6d-50fa-9c09-6e768a328fa6
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073859cc90>
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1d7b834-ea6d-50fa-9c09-6e768a328fa6/f1d7b834-ea6d-50fa-9c09-6e768a328fa6_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fae%252F7bae8879c885836d3f1070edb96a141c%252Fpa%252FMH50218_010f64ec5a10518f53eaa4b7b9f2b88a.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_010f64ec5a10518f53eaa4b7b9f2b88a.jpg saved to cache
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f1d7b834-ea6d-50fa-9c09-6e768a328fa6
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073868a450>
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1d7b834-ea6d-50fa-9c09-6e768a328fa6/f1d7b834-ea6d-50fa-9c09-6e768a328fa6_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fae%252F7bae8879c885836d3f1070edb96a141c%252Fpa%252FMH50218_92353713ea8b5d95ce4a4236b6da413e.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_92353713ea8b5d95ce4a4236b6da413e.jpg saved to cache
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f1d7b834-ea6d-50fa-9c09-6e768a328fa6
2026-03-30 11:21:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f1d7b834-ea6d-50fa-9c09-6e768a328fa6, skipping ID generation
2026-03-30 11:21:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1d7b834-ea6d-50fa-9c09-6e768a328fa6 with scrape type 1
2026-03-30 11:21:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f1d7b834-ea6d-50fa-9c09-6e768a328fa6 sending to next pipeline
2026-03-30 11:21:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f1d7b834-ea6d-50fa-9c09-6e768a328fa6, identifier: MH50218
2026-03-30 11:21:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f1d7b834-ea6d-50fa-9c09-6e768a328fa6 with identifier: MH50218
2026-03-30 11:21:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f1d7b834-ea6d-50fa-9c09-6e768a328fa6 with identifier: MH50218
2026-03-30 11:21:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f1d7b834-ea6d-50fa-9c09-6e768a328fa6 with identifier: MH50218 to the API
2026-03-30 11:21:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:21:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:21:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_92353713ea8b5d95ce4a4236b6da413e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:05:52Z',
'fuel_type': 'diesel',
'id': 'f1d7b834-ea6d-50fa-9c09-6e768a328fa6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH50218',
'listing': 'auction',
'location': 'FR, Fouquières-lès-Lens',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 118452,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1d7b834-ea6d-50fa-9c09-6e768a328fa6/f1d7b834-ea6d-50fa-9c09-6e768a328fa6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71335,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_784e3b02cc0addef20a856aaf4cdbaa8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1d7b834-ea6d-50fa-9c09-6e768a328fa6/f1d7b834-ea6d-50fa-9c09-6e768a328fa6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70548,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_7446235bcf55d9e915b2216a49d1652a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1d7b834-ea6d-50fa-9c09-6e768a328fa6/f1d7b834-ea6d-50fa-9c09-6e768a328fa6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63434,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_66597453830275e78e1e6fc06f5da82a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1d7b834-ea6d-50fa-9c09-6e768a328fa6/f1d7b834-ea6d-50fa-9c09-6e768a328fa6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57295,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_35a4e0081bf1e175b5041173539e1f03.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1d7b834-ea6d-50fa-9c09-6e768a328fa6/f1d7b834-ea6d-50fa-9c09-6e768a328fa6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59137,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_472365d27db0ee8fe9904b927cbd2a7f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1d7b834-ea6d-50fa-9c09-6e768a328fa6/f1d7b834-ea6d-50fa-9c09-6e768a328fa6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73687,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_4409b490d8dd608bf11bc7f2d357cbe0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1d7b834-ea6d-50fa-9c09-6e768a328fa6/f1d7b834-ea6d-50fa-9c09-6e768a328fa6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55892,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_fe52c0a252125cfc3cc6550ba76c1393.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1d7b834-ea6d-50fa-9c09-6e768a328fa6/f1d7b834-ea6d-50fa-9c09-6e768a328fa6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_010f64ec5a10518f53eaa4b7b9f2b88a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1d7b834-ea6d-50fa-9c09-6e768a328fa6/f1d7b834-ea6d-50fa-9c09-6e768a328fa6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65555,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_525e45ad62decf17c9e05ee858444851.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1d7b834-ea6d-50fa-9c09-6e768a328fa6/f1d7b834-ea6d-50fa-9c09-6e768a328fa6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/ae/7bae8879c885836d3f1070edb96a141c/pa/MH50218_92353713ea8b5d95ce4a4236b6da413e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 d Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2020}
2026-03-30 11:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH50218%27 HTTP/1.1" 200 None
2026-03-30 11:21:55 [auto1.fr] INFO: Saving data for MH50218: {'created_time': 1774869715.42877, 'last_price_update_time': 1774869715.428781, 'auction_closing_time': 1774969552.0}
2026-03-30 11:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MH50218') HTTP/1.1" 204 0
2026-03-30 11:21:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:21:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:56 [auto1.fr] INFO: Channel: 24h | Page: 16 | totalHits: 5578 | hits on page: 40
2026-03-30 11:21:56 [auto1.fr] INFO: Found listing with ID: ZN08846
2026-03-30 11:21:56 [auto1.fr] INFO: Found listing with ID: FX85984
2026-03-30 11:21:56 [auto1.fr] INFO: Found listing with ID: RV38404
2026-03-30 11:21:56 [auto1.fr] INFO: Found listing with ID: XJ76593
2026-03-30 11:21:56 [auto1.fr] INFO: Found listing with ID: RU91332
2026-03-30 11:21:56 [auto1.fr] INFO: Found listing with ID: YL76832
2026-03-30 11:21:56 [auto1.fr] INFO: Found listing with ID: DW24154
2026-03-30 11:21:56 [auto1.fr] INFO: Found listing with ID: TS11881
2026-03-30 11:21:56 [auto1.fr] INFO: Found listing with ID: KL52041
2026-03-30 11:21:56 [auto1.fr] INFO: Found listing with ID: DE92084
2026-03-30 11:21:56 [auto1.fr] INFO: Found listing with ID: FN42145
2026-03-30 11:21:56 [auto1.fr] INFO: Found listing with ID: PF51993
2026-03-30 11:21:56 [auto1.fr] INFO: Found listing with ID: RP02187
2026-03-30 11:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP02187%27 HTTP/1.1" 200 None
2026-03-30 11:21:56 [auto1.fr] INFO: Scrape type for RP02187: 2
2026-03-30 11:21:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31fe873f-f557-5402-8222-3b3bb3bc0cfb with identifier: RP02187
2026-03-30 11:21:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31fe873f-f557-5402-8222-3b3bb3bc0cfb with scrape type 2
2026-03-30 11:21:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31fe873f-f557-5402-8222-3b3bb3bc0cfb with scrape type 2
2026-03-30 11:21:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 31fe873f-f557-5402-8222-3b3bb3bc0cfb, identifier: RP02187
2026-03-30 11:21:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 31fe873f-f557-5402-8222-3b3bb3bc0cfb with identifier: RP02187
2026-03-30 11:21:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 31fe873f-f557-5402-8222-3b3bb3bc0cfb with identifier: RP02187
2026-03-30 11:21:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 31fe873f-f557-5402-8222-3b3bb3bc0cfb with identifier: RP02187 to the API
2026-03-30 11:21:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:21:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:21:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:17:16Z',
'fuel_type': 'diesel',
'id': '31fe873f-f557-5402-8222-3b3bb3bc0cfb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP02187',
'listing': 'auction',
'make': 'Peugeot',
'model': '5008',
'odometer': 139866,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-19',
'seller_name': None,
'title': 'Peugeot 5008 1.5 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2019}
2026-03-30 11:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP02187%27 HTTP/1.1" 200 None
2026-03-30 11:21:57 [auto1.fr] INFO: Saving data for RP02187: {'auction_closing_time': 1774970236.0, 'created_time': 1773234300.105623, 'last_price_update_time': 1774869717.531586}
2026-03-30 11:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RP02187') HTTP/1.1" 204 0
2026-03-30 11:21:57 [auto1.fr] INFO: Found listing with ID: YW96620
2026-03-30 11:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YW96620%27 HTTP/1.1" 200 None
2026-03-30 11:21:57 [auto1.fr] INFO: Scrape type for YW96620: 1
2026-03-30 11:21:57 [auto1.fr] INFO: Found listing with ID: YB41895
2026-03-30 11:21:57 [auto1.fr] INFO: Found listing with ID: SP91950
2026-03-30 11:21:57 [auto1.fr] INFO: Found listing with ID: KF87989
2026-03-30 11:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF87989%27 HTTP/1.1" 200 None
2026-03-30 11:21:57 [auto1.fr] INFO: Scrape type for KF87989: 2
2026-03-30 11:21:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04f7cf41-33e5-5421-8c40-d20335245b6c with identifier: KF87989
2026-03-30 11:21:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04f7cf41-33e5-5421-8c40-d20335245b6c with scrape type 2
2026-03-30 11:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04f7cf41-33e5-5421-8c40-d20335245b6c with scrape type 2
2026-03-30 11:21:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 04f7cf41-33e5-5421-8c40-d20335245b6c, identifier: KF87989
2026-03-30 11:21:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 04f7cf41-33e5-5421-8c40-d20335245b6c with identifier: KF87989
2026-03-30 11:21:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 04f7cf41-33e5-5421-8c40-d20335245b6c with identifier: KF87989
2026-03-30 11:21:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 04f7cf41-33e5-5421-8c40-d20335245b6c with identifier: KF87989 to the API
2026-03-30 11:21:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:21:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:21:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:07:41Z',
'fuel_type': 'petrol',
'id': '04f7cf41-33e5-5421-8c40-d20335245b6c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF87989',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 42025,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-06',
'seller_name': None,
'title': 'Peugeot 207 1.6 Premium',
'transmission': 'automatic',
'trim': 'Premium',
'year': 2011}
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF87989%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.fr] INFO: Saving data for KF87989: {'auction_closing_time': 1774969661.0, 'created_time': 1774278964.122707, 'last_price_update_time': 1774869718.107267}
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KF87989') HTTP/1.1" 204 0
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: AS36340
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS36340%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.fr] INFO: Scrape type for AS36340: 1
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: MD52514
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: KA23831
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA23831%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.fr] INFO: Scrape type for KA23831: 1
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: ES52369
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: NL28829
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL28829%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.fr] INFO: Scrape type for NL28829: 1
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: FS23281
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: YN72247
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: NP71394
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: KV16401
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: JN91782
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN91782%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.fr] INFO: Scrape type for JN91782: 1
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: GP12773
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP12773%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.fr] INFO: Scrape type for GP12773: 1
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: CH14191
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: JL11481
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: RA64429
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA64429%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.fr] INFO: Scrape type for RA64429: 1
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: CX62524
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX62524%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.fr] INFO: Scrape type for CX62524: 1
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: LH28225
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: PW51275
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PW51275%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.fr] INFO: Scrape type for PW51275: 1
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: YB91559
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: GE60554
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: MV42636
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV42636%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.fr] INFO: Scrape type for MV42636: 1
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: ZN76101
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN76101%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.fr] INFO: Scrape type for ZN76101: 1
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: RU12813
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU12813%27 HTTP/1.1" 200 None
2026-03-30 11:21:58 [auto1.fr] INFO: Scrape type for RU12813: 1
2026-03-30 11:21:58 [auto1.fr] INFO: Found listing with ID: CG93824
2026-03-30 11:22:05 [scrapy.extensions.logstats] INFO: Crawled 160 pages (at 13 pages/min), scraped 135 items (at 9 items/min)
2026-03-30 11:22:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:22:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU26545> (referer: https://www.auto1.com/v1/car-details-view/SU26545/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2103e762-d4f1-5307-9b50-c8c0ee5b134f with identifier: SU26545
2026-03-30 11:22:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2103e762-d4f1-5307-9b50-c8c0ee5b134f with scrape type 1
2026-03-30 11:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2103e762-d4f1-5307-9b50-c8c0ee5b134f
2026-03-30 11:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fec%252F75ec6350bcbeb8f1f6af15d5da6cc78f%252Fpa%252FSU26545_4829f06eb42c196f907fc816372cf513.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_4829f06eb42c196f907fc816372cf513.jpg not downloaded yet
2026-03-30 11:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fec%252F75ec6350bcbeb8f1f6af15d5da6cc78f%252Fpa%252FSU26545_e5077ec5aa6bc01df1e69bc25603654f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_e5077ec5aa6bc01df1e69bc25603654f.jpg not downloaded yet
2026-03-30 11:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fec%252F75ec6350bcbeb8f1f6af15d5da6cc78f%252Fpa%252FSU26545_b65a76e0caa5839c9fbfe0abee83347a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_b65a76e0caa5839c9fbfe0abee83347a.jpg not downloaded yet
2026-03-30 11:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fec%252F75ec6350bcbeb8f1f6af15d5da6cc78f%252Fpa%252FSU26545_81ac2f21fa91b120b447e922491ee8b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_81ac2f21fa91b120b447e922491ee8b8.jpg not downloaded yet
2026-03-30 11:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fec%252F75ec6350bcbeb8f1f6af15d5da6cc78f%252Fpa%252FSU26545_5b2d48e01804e480f92ce447fe1c2cea.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_5b2d48e01804e480f92ce447fe1c2cea.jpg not downloaded yet
2026-03-30 11:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fec%252F75ec6350bcbeb8f1f6af15d5da6cc78f%252Fpa%252FSU26545_430fccb62f19193f4e1e03319d0151e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_430fccb62f19193f4e1e03319d0151e5.jpg not downloaded yet
2026-03-30 11:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fec%252F75ec6350bcbeb8f1f6af15d5da6cc78f%252Fpa%252FSU26545_7147ccbec115981b46558f4db791f2fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_7147ccbec115981b46558f4db791f2fd.jpg not downloaded yet
2026-03-30 11:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fec%252F75ec6350bcbeb8f1f6af15d5da6cc78f%252Fpa%252FSU26545_ab532ab0cd2c9df148966ecdca1312f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_ab532ab0cd2c9df148966ecdca1312f2.jpg not downloaded yet
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fec%252F75ec6350bcbeb8f1f6af15d5da6cc78f%252Fpa%252FSU26545_e233f7c2677c15f7430f050eb8cfebdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_e233f7c2677c15f7430f050eb8cfebdc.jpg not downloaded yet
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fec%252F75ec6350bcbeb8f1f6af15d5da6cc78f%252Fpa%252FSU26545_45f452a6ec878de464a3342e5d2a7874.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_45f452a6ec878de464a3342e5d2a7874.jpg not downloaded yet
2026-03-30 11:22:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PV12001> (referer: https://www.auto1.com/v1/car-details-view/PV12001/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b907f72e-26d1-54e8-90e3-aef995b0d685 with identifier: PV12001
2026-03-30 11:22:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b907f72e-26d1-54e8-90e3-aef995b0d685 with scrape type 1
2026-03-30 11:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b907f72e-26d1-54e8-90e3-aef995b0d685
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7c%252F997cfb243468a25cd8f0798b6bb138d3%252Fpa%252FPV12001_67a88ecb2d278bceaa1dc0db3d93fffe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_67a88ecb2d278bceaa1dc0db3d93fffe.jpg not downloaded yet
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7c%252F997cfb243468a25cd8f0798b6bb138d3%252Fpa%252FPV12001_43df2cc70300c844a27e0bd38040c9af.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_43df2cc70300c844a27e0bd38040c9af.jpg not downloaded yet
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7c%252F997cfb243468a25cd8f0798b6bb138d3%252Fpa%252FPV12001_9a1c08211043c51cf670073611b30e60.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_9a1c08211043c51cf670073611b30e60.jpg not downloaded yet
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7c%252F997cfb243468a25cd8f0798b6bb138d3%252Fpa%252FPV12001_fba7129fb449f5d6d7b91875eafc78c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_fba7129fb449f5d6d7b91875eafc78c0.jpg not downloaded yet
2026-03-30 11:22:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_45f452a6ec878de464a3342e5d2a7874.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7c%252F997cfb243468a25cd8f0798b6bb138d3%252Fpa%252FPV12001_cb85150398ee52e0731b7f9e5b689e9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_cb85150398ee52e0731b7f9e5b689e9f.jpg not downloaded yet
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7c%252F997cfb243468a25cd8f0798b6bb138d3%252Fpa%252FPV12001_6478c92cdac1809a2cf1ca7535b0eeeb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_6478c92cdac1809a2cf1ca7535b0eeeb.jpg not downloaded yet
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7c%252F997cfb243468a25cd8f0798b6bb138d3%252Fpa%252FPV12001_6f21bf6866a45660a287c2542b665f80.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_6f21bf6866a45660a287c2542b665f80.jpg not downloaded yet
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7c%252F997cfb243468a25cd8f0798b6bb138d3%252Fpa%252FPV12001_28f1be6c4fac2750b1e34d9dbd2971d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_28f1be6c4fac2750b1e34d9dbd2971d9.jpg not downloaded yet
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7c%252F997cfb243468a25cd8f0798b6bb138d3%252Fpa%252FPV12001_1b90f81d4a0f45fb1284608fb2f32938.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_1b90f81d4a0f45fb1284608fb2f32938.jpg not downloaded yet
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7c%252F997cfb243468a25cd8f0798b6bb138d3%252Fpa%252FPV12001_cfdebd332bd88c2d1f50f5543741dab3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_cfdebd332bd88c2d1f50f5543741dab3.jpg not downloaded yet
2026-03-30 11:22:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_fba7129fb449f5d6d7b91875eafc78c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07387896d0>
2026-03-30 11:22:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2103e762-d4f1-5307-9b50-c8c0ee5b134f/2103e762-d4f1-5307-9b50-c8c0ee5b134f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fec%252F75ec6350bcbeb8f1f6af15d5da6cc78f%252Fpa%252FSU26545_45f452a6ec878de464a3342e5d2a7874.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_45f452a6ec878de464a3342e5d2a7874.jpg saved to cache
2026-03-30 11:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2103e762-d4f1-5307-9b50-c8c0ee5b134f
2026-03-30 11:22:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384bad10>
2026-03-30 11:22:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f72e-26d1-54e8-90e3-aef995b0d685/b907f72e-26d1-54e8-90e3-aef995b0d685_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7c%252F997cfb243468a25cd8f0798b6bb138d3%252Fpa%252FPV12001_fba7129fb449f5d6d7b91875eafc78c0.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_fba7129fb449f5d6d7b91875eafc78c0.jpg saved to cache
2026-03-30 11:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b907f72e-26d1-54e8-90e3-aef995b0d685
2026-03-30 11:22:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_1b90f81d4a0f45fb1284608fb2f32938.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SF81175> (referer: https://www.auto1.com/v1/car-details-view/SF81175/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_28f1be6c4fac2750b1e34d9dbd2971d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_cfdebd332bd88c2d1f50f5543741dab3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073868a710>
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f72e-26d1-54e8-90e3-aef995b0d685/b907f72e-26d1-54e8-90e3-aef995b0d685_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7c%252F997cfb243468a25cd8f0798b6bb138d3%252Fpa%252FPV12001_1b90f81d4a0f45fb1284608fb2f32938.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_1b90f81d4a0f45fb1284608fb2f32938.jpg saved to cache
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b907f72e-26d1-54e8-90e3-aef995b0d685
2026-03-30 11:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_6478c92cdac1809a2cf1ca7535b0eeeb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_6f21bf6866a45660a287c2542b665f80.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5919b95-bbb9-5016-89e3-de84208d674d with identifier: SF81175
2026-03-30 11:22:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5919b95-bbb9-5016-89e3-de84208d674d with scrape type 1
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5919b95-bbb9-5016-89e3-de84208d674d
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F00%252F4800a14e749e330d74ec0ad3bb481466%252Fpa%252FSF81175_d3d6c0239d8458c63a634de1fc2e47a0.png%27 HTTP/1.1" 200 None
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_d3d6c0239d8458c63a634de1fc2e47a0.png not downloaded yet
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F00%252F4800a14e749e330d74ec0ad3bb481466%252Fpa%252FSF81175_326923f944db2880cda1461d23ba5191.png%27 HTTP/1.1" 200 None
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_326923f944db2880cda1461d23ba5191.png not downloaded yet
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383ffed0>
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f72e-26d1-54e8-90e3-aef995b0d685/b907f72e-26d1-54e8-90e3-aef995b0d685_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7c%252F997cfb243468a25cd8f0798b6bb138d3%252Fpa%252FPV12001_28f1be6c4fac2750b1e34d9dbd2971d9.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_28f1be6c4fac2750b1e34d9dbd2971d9.jpg saved to cache
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b907f72e-26d1-54e8-90e3-aef995b0d685
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738535c10>
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f72e-26d1-54e8-90e3-aef995b0d685/b907f72e-26d1-54e8-90e3-aef995b0d685_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7c%252F997cfb243468a25cd8f0798b6bb138d3%252Fpa%252FPV12001_cfdebd332bd88c2d1f50f5543741dab3.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_cfdebd332bd88c2d1f50f5543741dab3.jpg saved to cache
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b907f72e-26d1-54e8-90e3-aef995b0d685
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F00%252F4800a14e749e330d74ec0ad3bb481466%252Fpa%252FSF81175_66d3b5defa59a489bf350de4c2f0dfb6.png%27 HTTP/1.1" 200 None
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_66d3b5defa59a489bf350de4c2f0dfb6.png not downloaded yet
2026-03-30 11:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_cb85150398ee52e0731b7f9e5b689e9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_9a1c08211043c51cf670073611b30e60.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F00%252F4800a14e749e330d74ec0ad3bb481466%252Fpa%252FSF81175_1bf494b9fc4b28473b52c169d65b1bcd.png%27 HTTP/1.1" 200 None
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_1bf494b9fc4b28473b52c169d65b1bcd.png not downloaded yet
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f074818f6d0>
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f72e-26d1-54e8-90e3-aef995b0d685/b907f72e-26d1-54e8-90e3-aef995b0d685_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7c%252F997cfb243468a25cd8f0798b6bb138d3%252Fpa%252FPV12001_6478c92cdac1809a2cf1ca7535b0eeeb.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_6478c92cdac1809a2cf1ca7535b0eeeb.jpg saved to cache
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b907f72e-26d1-54e8-90e3-aef995b0d685
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738597a10>
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f72e-26d1-54e8-90e3-aef995b0d685/b907f72e-26d1-54e8-90e3-aef995b0d685_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7c%252F997cfb243468a25cd8f0798b6bb138d3%252Fpa%252FPV12001_6f21bf6866a45660a287c2542b665f80.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_6f21bf6866a45660a287c2542b665f80.jpg saved to cache
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b907f72e-26d1-54e8-90e3-aef995b0d685
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F00%252F4800a14e749e330d74ec0ad3bb481466%252Fpa%252FSF81175_44cab771e1e34290cb8d8b34653eb091.png%27 HTTP/1.1" 200 None
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_44cab771e1e34290cb8d8b34653eb091.png not downloaded yet
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F00%252F4800a14e749e330d74ec0ad3bb481466%252Fpa%252FSF81175_3403c2c96444d427fb82553769d9c572.png%27 HTTP/1.1" 200 None
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_3403c2c96444d427fb82553769d9c572.png not downloaded yet
2026-03-30 11:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_326923f944db2880cda1461d23ba5191.png> (referer: https://www.auto1.com/)
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F00%252F4800a14e749e330d74ec0ad3bb481466%252Fpa%252FSF81175_2ebe07b528a51e70fc5cd51cce715062.png%27 HTTP/1.1" 200 None
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_2ebe07b528a51e70fc5cd51cce715062.png not downloaded yet
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738587ad0>
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f72e-26d1-54e8-90e3-aef995b0d685/b907f72e-26d1-54e8-90e3-aef995b0d685_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7c%252F997cfb243468a25cd8f0798b6bb138d3%252Fpa%252FPV12001_cb85150398ee52e0731b7f9e5b689e9f.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_cb85150398ee52e0731b7f9e5b689e9f.jpg saved to cache
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b907f72e-26d1-54e8-90e3-aef995b0d685
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738717cd0>
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f72e-26d1-54e8-90e3-aef995b0d685/b907f72e-26d1-54e8-90e3-aef995b0d685_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7c%252F997cfb243468a25cd8f0798b6bb138d3%252Fpa%252FPV12001_9a1c08211043c51cf670073611b30e60.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_9a1c08211043c51cf670073611b30e60.jpg saved to cache
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b907f72e-26d1-54e8-90e3-aef995b0d685
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F00%252F4800a14e749e330d74ec0ad3bb481466%252Fpa%252FSF81175_73448758fc5e5b9c3269a4f0c4e73a15.png%27 HTTP/1.1" 200 None
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_73448758fc5e5b9c3269a4f0c4e73a15.png not downloaded yet
2026-03-30 11:22:09 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:22:09 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:22:09 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a7ea690>
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5919b95-bbb9-5016-89e3-de84208d674d/b5919b95-bbb9-5016-89e3-de84208d674d_image_1.png HTTP/1.1" 201 0
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F00%252F4800a14e749e330d74ec0ad3bb481466%252Fpa%252FSF81175_326923f944db2880cda1461d23ba5191.png') HTTP/1.1" 204 0
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_326923f944db2880cda1461d23ba5191.png saved to cache
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b5919b95-bbb9-5016-89e3-de84208d674d
2026-03-30 11:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_66d3b5defa59a489bf350de4c2f0dfb6.png> (referer: https://www.auto1.com/)
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F00%252F4800a14e749e330d74ec0ad3bb481466%252Fpa%252FSF81175_1f715ff99ad45193b492da06206d173a.png%27 HTTP/1.1" 200 None
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_1f715ff99ad45193b492da06206d173a.png not downloaded yet
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F00%252F4800a14e749e330d74ec0ad3bb481466%252Fpa%252FSF81175_52dcbbf571895bc86066bfd9c6c2f1e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_52dcbbf571895bc86066bfd9c6c2f1e2.jpg not downloaded yet
2026-03-30 11:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_3403c2c96444d427fb82553769d9c572.png> (referer: https://www.auto1.com/)
2026-03-30 11:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_52dcbbf571895bc86066bfd9c6c2f1e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:09 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:22:09 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:22:09 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383aa510>
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5919b95-bbb9-5016-89e3-de84208d674d/b5919b95-bbb9-5016-89e3-de84208d674d_image_2.png HTTP/1.1" 201 0
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F00%252F4800a14e749e330d74ec0ad3bb481466%252Fpa%252FSF81175_66d3b5defa59a489bf350de4c2f0dfb6.png') HTTP/1.1" 204 0
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_66d3b5defa59a489bf350de4c2f0dfb6.png saved to cache
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b5919b95-bbb9-5016-89e3-de84208d674d
2026-03-30 11:22:09 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:22:09 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:22:09 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384b7d50>
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5919b95-bbb9-5016-89e3-de84208d674d/b5919b95-bbb9-5016-89e3-de84208d674d_image_5.png HTTP/1.1" 201 0
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F00%252F4800a14e749e330d74ec0ad3bb481466%252Fpa%252FSF81175_3403c2c96444d427fb82553769d9c572.png') HTTP/1.1" 204 0
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_3403c2c96444d427fb82553769d9c572.png saved to cache
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5919b95-bbb9-5016-89e3-de84208d674d
2026-03-30 11:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_73448758fc5e5b9c3269a4f0c4e73a15.png> (referer: https://www.auto1.com/)
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073871d410>
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5919b95-bbb9-5016-89e3-de84208d674d/b5919b95-bbb9-5016-89e3-de84208d674d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F00%252F4800a14e749e330d74ec0ad3bb481466%252Fpa%252FSF81175_52dcbbf571895bc86066bfd9c6c2f1e2.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_52dcbbf571895bc86066bfd9c6c2f1e2.jpg saved to cache
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b5919b95-bbb9-5016-89e3-de84208d674d
2026-03-30 11:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_2ebe07b528a51e70fc5cd51cce715062.png> (referer: https://www.auto1.com/)
2026-03-30 11:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_1f715ff99ad45193b492da06206d173a.png> (referer: https://www.auto1.com/)
2026-03-30 11:22:09 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:22:09 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:22:09 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738425710>
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5919b95-bbb9-5016-89e3-de84208d674d/b5919b95-bbb9-5016-89e3-de84208d674d_image_7.png HTTP/1.1" 201 0
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F00%252F4800a14e749e330d74ec0ad3bb481466%252Fpa%252FSF81175_73448758fc5e5b9c3269a4f0c4e73a15.png') HTTP/1.1" 204 0
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_73448758fc5e5b9c3269a4f0c4e73a15.png saved to cache
2026-03-30 11:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b5919b95-bbb9-5016-89e3-de84208d674d
2026-03-30 11:22:09 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:22:09 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:22:09 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073871d8d0>
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5919b95-bbb9-5016-89e3-de84208d674d/b5919b95-bbb9-5016-89e3-de84208d674d_image_6.png HTTP/1.1" 201 0
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F00%252F4800a14e749e330d74ec0ad3bb481466%252Fpa%252FSF81175_2ebe07b528a51e70fc5cd51cce715062.png') HTTP/1.1" 204 0
2026-03-30 11:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_2ebe07b528a51e70fc5cd51cce715062.png saved to cache
2026-03-30 11:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b5919b95-bbb9-5016-89e3-de84208d674d
2026-03-30 11:22:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:22:10 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:22:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a7be110>
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5919b95-bbb9-5016-89e3-de84208d674d/b5919b95-bbb9-5016-89e3-de84208d674d_image_8.png HTTP/1.1" 201 0
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F00%252F4800a14e749e330d74ec0ad3bb481466%252Fpa%252FSF81175_1f715ff99ad45193b492da06206d173a.png') HTTP/1.1" 204 0
2026-03-30 11:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_1f715ff99ad45193b492da06206d173a.png saved to cache
2026-03-30 11:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b5919b95-bbb9-5016-89e3-de84208d674d
2026-03-30 11:22:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_1bf494b9fc4b28473b52c169d65b1bcd.png> (referer: https://www.auto1.com/)
2026-03-30 11:22:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_44cab771e1e34290cb8d8b34653eb091.png> (referer: https://www.auto1.com/)
2026-03-30 11:22:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_43df2cc70300c844a27e0bd38040c9af.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_d3d6c0239d8458c63a634de1fc2e47a0.png> (referer: https://www.auto1.com/)
2026-03-30 11:22:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_67a88ecb2d278bceaa1dc0db3d93fffe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:22:10 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:22:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738424050>
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5919b95-bbb9-5016-89e3-de84208d674d/b5919b95-bbb9-5016-89e3-de84208d674d_image_3.png HTTP/1.1" 201 0
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F00%252F4800a14e749e330d74ec0ad3bb481466%252Fpa%252FSF81175_1bf494b9fc4b28473b52c169d65b1bcd.png') HTTP/1.1" 204 0
2026-03-30 11:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_1bf494b9fc4b28473b52c169d65b1bcd.png saved to cache
2026-03-30 11:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b5919b95-bbb9-5016-89e3-de84208d674d
2026-03-30 11:22:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:22:10 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:22:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385ec710>
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5919b95-bbb9-5016-89e3-de84208d674d/b5919b95-bbb9-5016-89e3-de84208d674d_image_4.png HTTP/1.1" 201 0
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F00%252F4800a14e749e330d74ec0ad3bb481466%252Fpa%252FSF81175_44cab771e1e34290cb8d8b34653eb091.png') HTTP/1.1" 204 0
2026-03-30 11:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_44cab771e1e34290cb8d8b34653eb091.png saved to cache
2026-03-30 11:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b5919b95-bbb9-5016-89e3-de84208d674d
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738447610>
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f72e-26d1-54e8-90e3-aef995b0d685/b907f72e-26d1-54e8-90e3-aef995b0d685_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7c%252F997cfb243468a25cd8f0798b6bb138d3%252Fpa%252FPV12001_43df2cc70300c844a27e0bd38040c9af.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_43df2cc70300c844a27e0bd38040c9af.jpg saved to cache
2026-03-30 11:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b907f72e-26d1-54e8-90e3-aef995b0d685
2026-03-30 11:22:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:22:10 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:22:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a535290>
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5919b95-bbb9-5016-89e3-de84208d674d/b5919b95-bbb9-5016-89e3-de84208d674d_image_0.png HTTP/1.1" 201 0
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F00%252F4800a14e749e330d74ec0ad3bb481466%252Fpa%252FSF81175_d3d6c0239d8458c63a634de1fc2e47a0.png') HTTP/1.1" 204 0
2026-03-30 11:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_d3d6c0239d8458c63a634de1fc2e47a0.png saved to cache
2026-03-30 11:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5919b95-bbb9-5016-89e3-de84208d674d
2026-03-30 11:22:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5919b95-bbb9-5016-89e3-de84208d674d, skipping ID generation
2026-03-30 11:22:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5919b95-bbb9-5016-89e3-de84208d674d with scrape type 1
2026-03-30 11:22:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5919b95-bbb9-5016-89e3-de84208d674d sending to next pipeline
2026-03-30 11:22:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b5919b95-bbb9-5016-89e3-de84208d674d, identifier: SF81175
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384b6c50>
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f72e-26d1-54e8-90e3-aef995b0d685/b907f72e-26d1-54e8-90e3-aef995b0d685_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7c%252F997cfb243468a25cd8f0798b6bb138d3%252Fpa%252FPV12001_67a88ecb2d278bceaa1dc0db3d93fffe.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_67a88ecb2d278bceaa1dc0db3d93fffe.jpg saved to cache
2026-03-30 11:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b907f72e-26d1-54e8-90e3-aef995b0d685
2026-03-30 11:22:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b907f72e-26d1-54e8-90e3-aef995b0d685, skipping ID generation
2026-03-30 11:22:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b907f72e-26d1-54e8-90e3-aef995b0d685 with scrape type 1
2026-03-30 11:22:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b907f72e-26d1-54e8-90e3-aef995b0d685 sending to next pipeline
2026-03-30 11:22:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b907f72e-26d1-54e8-90e3-aef995b0d685, identifier: PV12001
2026-03-30 11:22:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b5919b95-bbb9-5016-89e3-de84208d674d with identifier: SF81175
2026-03-30 11:22:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b5919b95-bbb9-5016-89e3-de84208d674d with identifier: SF81175
2026-03-30 11:22:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b5919b95-bbb9-5016-89e3-de84208d674d with identifier: SF81175 to the API
2026-03-30 11:22:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_d3d6c0239d8458c63a634de1fc2e47a0.png>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'engine_horse_power': 158,
'expiration_date': '2026-03-31T15:58:00Z',
'fuel_type': 'petrol',
'id': 'b5919b95-bbb9-5016-89e3-de84208d674d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF81175',
'listing': 'auction',
'location': 'FR',
'make': 'Renault',
'model': 'Captur',
'odometer': 104475,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5919b95-bbb9-5016-89e3-de84208d674d/b5919b95-bbb9-5016-89e3-de84208d674d_image_0.png',
'Extension': 'png',
'FileSizeInBytes': 681292,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_d3d6c0239d8458c63a634de1fc2e47a0.png',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5919b95-bbb9-5016-89e3-de84208d674d/b5919b95-bbb9-5016-89e3-de84208d674d_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_326923f944db2880cda1461d23ba5191.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5919b95-bbb9-5016-89e3-de84208d674d/b5919b95-bbb9-5016-89e3-de84208d674d_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_66d3b5defa59a489bf350de4c2f0dfb6.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5919b95-bbb9-5016-89e3-de84208d674d/b5919b95-bbb9-5016-89e3-de84208d674d_image_3.png',
'Extension': 'png',
'FileSizeInBytes': 627277,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_1bf494b9fc4b28473b52c169d65b1bcd.png',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5919b95-bbb9-5016-89e3-de84208d674d/b5919b95-bbb9-5016-89e3-de84208d674d_image_4.png',
'Extension': 'png',
'FileSizeInBytes': 688016,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_44cab771e1e34290cb8d8b34653eb091.png',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5919b95-bbb9-5016-89e3-de84208d674d/b5919b95-bbb9-5016-89e3-de84208d674d_image_5.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_3403c2c96444d427fb82553769d9c572.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5919b95-bbb9-5016-89e3-de84208d674d/b5919b95-bbb9-5016-89e3-de84208d674d_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_2ebe07b528a51e70fc5cd51cce715062.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5919b95-bbb9-5016-89e3-de84208d674d/b5919b95-bbb9-5016-89e3-de84208d674d_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_73448758fc5e5b9c3269a4f0c4e73a15.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5919b95-bbb9-5016-89e3-de84208d674d/b5919b95-bbb9-5016-89e3-de84208d674d_image_8.png',
'Extension': 'png',
'FileSizeInBytes': 775650,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_1f715ff99ad45193b492da06206d173a.png',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5919b95-bbb9-5016-89e3-de84208d674d/b5919b95-bbb9-5016-89e3-de84208d674d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/00/4800a14e749e330d74ec0ad3bb481466/pa/SF81175_52dcbbf571895bc86066bfd9c6c2f1e2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-08',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.3 TCe Mild-Hybrid R.S. Line',
'transmission': 'automatic',
'trim': 'R.S. Line',
'year': 2022}
2026-03-30 11:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF81175%27 HTTP/1.1" 200 None
2026-03-30 11:22:11 [auto1.fr] INFO: Saving data for SF81175: {'created_time': 1774869731.356718, 'last_price_update_time': 1774869731.356729, 'auction_closing_time': 1774972680.0}
2026-03-30 11:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SF81175') HTTP/1.1" 204 0
2026-03-30 11:22:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b907f72e-26d1-54e8-90e3-aef995b0d685 with identifier: PV12001
2026-03-30 11:22:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b907f72e-26d1-54e8-90e3-aef995b0d685 with identifier: PV12001
2026-03-30 11:22:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b907f72e-26d1-54e8-90e3-aef995b0d685 with identifier: PV12001 to the API
2026-03-30 11:22:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_67a88ecb2d278bceaa1dc0db3d93fffe.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:27:26Z',
'fuel_type': 'diesel',
'id': 'b907f72e-26d1-54e8-90e3-aef995b0d685',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV12001',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 166172,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f72e-26d1-54e8-90e3-aef995b0d685/b907f72e-26d1-54e8-90e3-aef995b0d685_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88986,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_67a88ecb2d278bceaa1dc0db3d93fffe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f72e-26d1-54e8-90e3-aef995b0d685/b907f72e-26d1-54e8-90e3-aef995b0d685_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87088,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_43df2cc70300c844a27e0bd38040c9af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f72e-26d1-54e8-90e3-aef995b0d685/b907f72e-26d1-54e8-90e3-aef995b0d685_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104407,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_9a1c08211043c51cf670073611b30e60.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f72e-26d1-54e8-90e3-aef995b0d685/b907f72e-26d1-54e8-90e3-aef995b0d685_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90236,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_fba7129fb449f5d6d7b91875eafc78c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f72e-26d1-54e8-90e3-aef995b0d685/b907f72e-26d1-54e8-90e3-aef995b0d685_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95318,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_cb85150398ee52e0731b7f9e5b689e9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f72e-26d1-54e8-90e3-aef995b0d685/b907f72e-26d1-54e8-90e3-aef995b0d685_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100993,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_6478c92cdac1809a2cf1ca7535b0eeeb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f72e-26d1-54e8-90e3-aef995b0d685/b907f72e-26d1-54e8-90e3-aef995b0d685_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88400,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_6f21bf6866a45660a287c2542b665f80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f72e-26d1-54e8-90e3-aef995b0d685/b907f72e-26d1-54e8-90e3-aef995b0d685_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79376,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_28f1be6c4fac2750b1e34d9dbd2971d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f72e-26d1-54e8-90e3-aef995b0d685/b907f72e-26d1-54e8-90e3-aef995b0d685_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_1b90f81d4a0f45fb1284608fb2f32938.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f72e-26d1-54e8-90e3-aef995b0d685/b907f72e-26d1-54e8-90e3-aef995b0d685_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/7c/997cfb243468a25cd8f0798b6bb138d3/pa/PV12001_cfdebd332bd88c2d1f50f5543741dab3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-30',
'seats_number': 7,
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 1.6 Blue-HDi Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2018}
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV12001%27 HTTP/1.1" 200 None
2026-03-30 11:22:12 [auto1.fr] INFO: Saving data for PV12001: {'created_time': 1774869732.213154, 'last_price_update_time': 1774869732.213164, 'auction_closing_time': 1774970846.0}
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PV12001') HTTP/1.1" 204 0
2026-03-30 11:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_e233f7c2677c15f7430f050eb8cfebdc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_ab532ab0cd2c9df148966ecdca1312f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YW96620/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_7147ccbec115981b46558f4db791f2fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384a9150>
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2103e762-d4f1-5307-9b50-c8c0ee5b134f/2103e762-d4f1-5307-9b50-c8c0ee5b134f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fec%252F75ec6350bcbeb8f1f6af15d5da6cc78f%252Fpa%252FSU26545_e233f7c2677c15f7430f050eb8cfebdc.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_e233f7c2677c15f7430f050eb8cfebdc.jpg saved to cache
2026-03-30 11:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2103e762-d4f1-5307-9b50-c8c0ee5b134f
2026-03-30 11:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_81ac2f21fa91b120b447e922491ee8b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384a7650>
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2103e762-d4f1-5307-9b50-c8c0ee5b134f/2103e762-d4f1-5307-9b50-c8c0ee5b134f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fec%252F75ec6350bcbeb8f1f6af15d5da6cc78f%252Fpa%252FSU26545_ab532ab0cd2c9df148966ecdca1312f2.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_ab532ab0cd2c9df148966ecdca1312f2.jpg saved to cache
2026-03-30 11:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2103e762-d4f1-5307-9b50-c8c0ee5b134f
2026-03-30 11:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_5b2d48e01804e480f92ce447fe1c2cea.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073867d090>
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2103e762-d4f1-5307-9b50-c8c0ee5b134f/2103e762-d4f1-5307-9b50-c8c0ee5b134f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fec%252F75ec6350bcbeb8f1f6af15d5da6cc78f%252Fpa%252FSU26545_7147ccbec115981b46558f4db791f2fd.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_7147ccbec115981b46558f4db791f2fd.jpg saved to cache
2026-03-30 11:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2103e762-d4f1-5307-9b50-c8c0ee5b134f
2026-03-30 11:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_430fccb62f19193f4e1e03319d0151e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738555690>
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2103e762-d4f1-5307-9b50-c8c0ee5b134f/2103e762-d4f1-5307-9b50-c8c0ee5b134f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fec%252F75ec6350bcbeb8f1f6af15d5da6cc78f%252Fpa%252FSU26545_81ac2f21fa91b120b447e922491ee8b8.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_81ac2f21fa91b120b447e922491ee8b8.jpg saved to cache
2026-03-30 11:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2103e762-d4f1-5307-9b50-c8c0ee5b134f
2026-03-30 11:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_b65a76e0caa5839c9fbfe0abee83347a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384bd190>
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2103e762-d4f1-5307-9b50-c8c0ee5b134f/2103e762-d4f1-5307-9b50-c8c0ee5b134f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fec%252F75ec6350bcbeb8f1f6af15d5da6cc78f%252Fpa%252FSU26545_5b2d48e01804e480f92ce447fe1c2cea.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_5b2d48e01804e480f92ce447fe1c2cea.jpg saved to cache
2026-03-30 11:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2103e762-d4f1-5307-9b50-c8c0ee5b134f
2026-03-30 11:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_e5077ec5aa6bc01df1e69bc25603654f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_4829f06eb42c196f907fc816372cf513.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383c4990>
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2103e762-d4f1-5307-9b50-c8c0ee5b134f/2103e762-d4f1-5307-9b50-c8c0ee5b134f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fec%252F75ec6350bcbeb8f1f6af15d5da6cc78f%252Fpa%252FSU26545_430fccb62f19193f4e1e03319d0151e5.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_430fccb62f19193f4e1e03319d0151e5.jpg saved to cache
2026-03-30 11:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2103e762-d4f1-5307-9b50-c8c0ee5b134f
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385aad10>
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2103e762-d4f1-5307-9b50-c8c0ee5b134f/2103e762-d4f1-5307-9b50-c8c0ee5b134f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fec%252F75ec6350bcbeb8f1f6af15d5da6cc78f%252Fpa%252FSU26545_b65a76e0caa5839c9fbfe0abee83347a.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_b65a76e0caa5839c9fbfe0abee83347a.jpg saved to cache
2026-03-30 11:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2103e762-d4f1-5307-9b50-c8c0ee5b134f
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383dae10>
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2103e762-d4f1-5307-9b50-c8c0ee5b134f/2103e762-d4f1-5307-9b50-c8c0ee5b134f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fec%252F75ec6350bcbeb8f1f6af15d5da6cc78f%252Fpa%252FSU26545_e5077ec5aa6bc01df1e69bc25603654f.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_e5077ec5aa6bc01df1e69bc25603654f.jpg saved to cache
2026-03-30 11:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2103e762-d4f1-5307-9b50-c8c0ee5b134f
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07393f4850>
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2103e762-d4f1-5307-9b50-c8c0ee5b134f/2103e762-d4f1-5307-9b50-c8c0ee5b134f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fec%252F75ec6350bcbeb8f1f6af15d5da6cc78f%252Fpa%252FSU26545_4829f06eb42c196f907fc816372cf513.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_4829f06eb42c196f907fc816372cf513.jpg saved to cache
2026-03-30 11:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2103e762-d4f1-5307-9b50-c8c0ee5b134f
2026-03-30 11:22:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2103e762-d4f1-5307-9b50-c8c0ee5b134f, skipping ID generation
2026-03-30 11:22:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2103e762-d4f1-5307-9b50-c8c0ee5b134f with scrape type 1
2026-03-30 11:22:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2103e762-d4f1-5307-9b50-c8c0ee5b134f sending to next pipeline
2026-03-30 11:22:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2103e762-d4f1-5307-9b50-c8c0ee5b134f, identifier: SU26545
2026-03-30 11:22:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2103e762-d4f1-5307-9b50-c8c0ee5b134f with identifier: SU26545
2026-03-30 11:22:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2103e762-d4f1-5307-9b50-c8c0ee5b134f with identifier: SU26545
2026-03-30 11:22:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2103e762-d4f1-5307-9b50-c8c0ee5b134f with identifier: SU26545 to the API
2026-03-30 11:22:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_4829f06eb42c196f907fc816372cf513.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.1L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:12:31Z',
'fuel_type': 'petrol',
'id': '2103e762-d4f1-5307-9b50-c8c0ee5b134f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU26545',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Renault',
'model': 'Twingo',
'odometer': 70783,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2103e762-d4f1-5307-9b50-c8c0ee5b134f/2103e762-d4f1-5307-9b50-c8c0ee5b134f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52907,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_4829f06eb42c196f907fc816372cf513.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2103e762-d4f1-5307-9b50-c8c0ee5b134f/2103e762-d4f1-5307-9b50-c8c0ee5b134f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101070,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_e5077ec5aa6bc01df1e69bc25603654f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2103e762-d4f1-5307-9b50-c8c0ee5b134f/2103e762-d4f1-5307-9b50-c8c0ee5b134f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55340,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_b65a76e0caa5839c9fbfe0abee83347a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2103e762-d4f1-5307-9b50-c8c0ee5b134f/2103e762-d4f1-5307-9b50-c8c0ee5b134f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45734,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_81ac2f21fa91b120b447e922491ee8b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2103e762-d4f1-5307-9b50-c8c0ee5b134f/2103e762-d4f1-5307-9b50-c8c0ee5b134f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48751,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_5b2d48e01804e480f92ce447fe1c2cea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2103e762-d4f1-5307-9b50-c8c0ee5b134f/2103e762-d4f1-5307-9b50-c8c0ee5b134f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50506,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_430fccb62f19193f4e1e03319d0151e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2103e762-d4f1-5307-9b50-c8c0ee5b134f/2103e762-d4f1-5307-9b50-c8c0ee5b134f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46607,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_7147ccbec115981b46558f4db791f2fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2103e762-d4f1-5307-9b50-c8c0ee5b134f/2103e762-d4f1-5307-9b50-c8c0ee5b134f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89066,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_ab532ab0cd2c9df148966ecdca1312f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2103e762-d4f1-5307-9b50-c8c0ee5b134f/2103e762-d4f1-5307-9b50-c8c0ee5b134f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71302,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_e233f7c2677c15f7430f050eb8cfebdc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2103e762-d4f1-5307-9b50-c8c0ee5b134f/2103e762-d4f1-5307-9b50-c8c0ee5b134f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54332,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/ec/75ec6350bcbeb8f1f6af15d5da6cc78f/pa/SU26545_45f452a6ec878de464a3342e5d2a7874.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-11-13',
'seats_number': 4,
'seller_name': None,
'title': 'Renault Twingo 1.2 Authentique',
'transmission': 'manual',
'trim': 'Authentique',
'year': 2011}
2026-03-30 11:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU26545%27 HTTP/1.1" 200 None
2026-03-30 11:22:13 [auto1.fr] INFO: Saving data for SU26545: {'created_time': 1774869733.218804, 'last_price_update_time': 1774869733.218815, 'auction_closing_time': 1774969951.0}
2026-03-30 11:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SU26545') HTTP/1.1" 204 0
2026-03-30 11:22:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA42500> (referer: https://www.auto1.com/v1/car-details-view/SA42500/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2199f46b-6f15-5664-991d-4814ef470396 with identifier: SA42500
2026-03-30 11:22:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2199f46b-6f15-5664-991d-4814ef470396 with scrape type 1
2026-03-30 11:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2199f46b-6f15-5664-991d-4814ef470396
2026-03-30 11:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F1a%252F3e1a17b2f851ebf2d366e056f1b822b7%252Fpa%252FSA42500_d9d3292533f59ba4c82f8a973c882ef5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_d9d3292533f59ba4c82f8a973c882ef5.jpg not downloaded yet
2026-03-30 11:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F1a%252F3e1a17b2f851ebf2d366e056f1b822b7%252Fpa%252FSA42500_36dad7e4144193ca575167cb6fdd3ff1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_36dad7e4144193ca575167cb6fdd3ff1.jpg not downloaded yet
2026-03-30 11:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F1a%252F3e1a17b2f851ebf2d366e056f1b822b7%252Fpa%252FSA42500_979464914e119065ae05e322b06dec3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_979464914e119065ae05e322b06dec3f.jpg not downloaded yet
2026-03-30 11:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F1a%252F3e1a17b2f851ebf2d366e056f1b822b7%252Fpa%252FSA42500_fb5e50d988678fd79f3555fa1f411a4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_fb5e50d988678fd79f3555fa1f411a4e.jpg not downloaded yet
2026-03-30 11:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F1a%252F3e1a17b2f851ebf2d366e056f1b822b7%252Fpa%252FSA42500_10a37abcfc7202916adeb22fa9f83167.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_10a37abcfc7202916adeb22fa9f83167.jpg not downloaded yet
2026-03-30 11:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F1a%252F3e1a17b2f851ebf2d366e056f1b822b7%252Fpa%252FSA42500_b32a9821efb4c261c6e9f2b07a4d805d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_b32a9821efb4c261c6e9f2b07a4d805d.jpg not downloaded yet
2026-03-30 11:22:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AS36340/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_b32a9821efb4c261c6e9f2b07a4d805d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383d92d0>
2026-03-30 11:22:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2199f46b-6f15-5664-991d-4814ef470396/2199f46b-6f15-5664-991d-4814ef470396_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F1a%252F3e1a17b2f851ebf2d366e056f1b822b7%252Fpa%252FSA42500_b32a9821efb4c261c6e9f2b07a4d805d.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_b32a9821efb4c261c6e9f2b07a4d805d.jpg saved to cache
2026-03-30 11:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2199f46b-6f15-5664-991d-4814ef470396
2026-03-30 11:22:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KA23831/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_10a37abcfc7202916adeb22fa9f83167.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_fb5e50d988678fd79f3555fa1f411a4e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738704b90>
2026-03-30 11:22:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2199f46b-6f15-5664-991d-4814ef470396/2199f46b-6f15-5664-991d-4814ef470396_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F1a%252F3e1a17b2f851ebf2d366e056f1b822b7%252Fpa%252FSA42500_10a37abcfc7202916adeb22fa9f83167.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_10a37abcfc7202916adeb22fa9f83167.jpg saved to cache
2026-03-30 11:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2199f46b-6f15-5664-991d-4814ef470396
2026-03-30 11:22:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383af410>
2026-03-30 11:22:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2199f46b-6f15-5664-991d-4814ef470396/2199f46b-6f15-5664-991d-4814ef470396_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F1a%252F3e1a17b2f851ebf2d366e056f1b822b7%252Fpa%252FSA42500_fb5e50d988678fd79f3555fa1f411a4e.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_fb5e50d988678fd79f3555fa1f411a4e.jpg saved to cache
2026-03-30 11:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2199f46b-6f15-5664-991d-4814ef470396
2026-03-30 11:22:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN91782/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_979464914e119065ae05e322b06dec3f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_36dad7e4144193ca575167cb6fdd3ff1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738596110>
2026-03-30 11:22:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2199f46b-6f15-5664-991d-4814ef470396/2199f46b-6f15-5664-991d-4814ef470396_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F1a%252F3e1a17b2f851ebf2d366e056f1b822b7%252Fpa%252FSA42500_979464914e119065ae05e322b06dec3f.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_979464914e119065ae05e322b06dec3f.jpg saved to cache
2026-03-30 11:22:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2199f46b-6f15-5664-991d-4814ef470396
2026-03-30 11:22:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383c1950>
2026-03-30 11:22:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2199f46b-6f15-5664-991d-4814ef470396/2199f46b-6f15-5664-991d-4814ef470396_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F1a%252F3e1a17b2f851ebf2d366e056f1b822b7%252Fpa%252FSA42500_36dad7e4144193ca575167cb6fdd3ff1.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_36dad7e4144193ca575167cb6fdd3ff1.jpg saved to cache
2026-03-30 11:22:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2199f46b-6f15-5664-991d-4814ef470396
2026-03-30 11:22:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU91332> (referer: https://www.auto1.com/v1/car-details-view/RU91332/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_d9d3292533f59ba4c82f8a973c882ef5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be483c22-8d8f-5578-9cc8-5f9e05568bf3 with identifier: RU91332
2026-03-30 11:22:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be483c22-8d8f-5578-9cc8-5f9e05568bf3 with scrape type 1
2026-03-30 11:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item be483c22-8d8f-5578-9cc8-5f9e05568bf3
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F42%252F8c4210c2ab719eb423783f62e3aa36a0%252Fpa%252FRU91332_c073ad40ca20cdafacb433a604fc1e08.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/42/8c4210c2ab719eb423783f62e3aa36a0/pa/RU91332_c073ad40ca20cdafacb433a604fc1e08.jpg already downloaded
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F42%252F8c4210c2ab719eb423783f62e3aa36a0%252Fpa%252FRU91332_4adaadfdcea3c924f95fd259c3137a53.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/42/8c4210c2ab719eb423783f62e3aa36a0/pa/RU91332_4adaadfdcea3c924f95fd259c3137a53.jpg already downloaded
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F42%252F8c4210c2ab719eb423783f62e3aa36a0%252Fpa%252FRU91332_1fcf614e09d60ed54452da0aece51a17.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/42/8c4210c2ab719eb423783f62e3aa36a0/pa/RU91332_1fcf614e09d60ed54452da0aece51a17.jpg already downloaded
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F42%252F8c4210c2ab719eb423783f62e3aa36a0%252Fpa%252FRU91332_ef4fac4017596f0e4bd5c13ab3bb2de6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/42/8c4210c2ab719eb423783f62e3aa36a0/pa/RU91332_ef4fac4017596f0e4bd5c13ab3bb2de6.jpg already downloaded
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F42%252F8c4210c2ab719eb423783f62e3aa36a0%252Fpa%252FRU91332_5686960cb5083203c2f1eb64366d8dde.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/42/8c4210c2ab719eb423783f62e3aa36a0/pa/RU91332_5686960cb5083203c2f1eb64366d8dde.jpg already downloaded
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F42%252F8c4210c2ab719eb423783f62e3aa36a0%252Fpa%252FRU91332_87432a7dbcdf696493484baede6009f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/42/8c4210c2ab719eb423783f62e3aa36a0/pa/RU91332_87432a7dbcdf696493484baede6009f5.jpg already downloaded
2026-03-30 11:22:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: be483c22-8d8f-5578-9cc8-5f9e05568bf3, identifier: RU91332
2026-03-30 11:22:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: be483c22-8d8f-5578-9cc8-5f9e05568bf3 with identifier: RU91332
2026-03-30 11:22:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: be483c22-8d8f-5578-9cc8-5f9e05568bf3 with identifier: RU91332
2026-03-30 11:22:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: be483c22-8d8f-5578-9cc8-5f9e05568bf3 with identifier: RU91332 to the API
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RU91332>
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 160,
'expiration_date': '2026-03-31T15:50:30Z',
'fuel_type': 'diesel',
'id': 'be483c22-8d8f-5578-9cc8-5f9e05568bf3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU91332',
'listing': 'auction',
'location': 'FR, Creutzwald',
'make': 'Renault',
'model': 'Megane',
'odometer': 230785,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img8c/42/8c4210c2ab719eb423783f62e3aa36a0/pa/RU91332_c073ad40ca20cdafacb433a604fc1e08.jpg',
'https://img-pa.auto1.com/img8c/42/8c4210c2ab719eb423783f62e3aa36a0/pa/RU91332_4adaadfdcea3c924f95fd259c3137a53.jpg',
'https://img-pa.auto1.com/img8c/42/8c4210c2ab719eb423783f62e3aa36a0/pa/RU91332_1fcf614e09d60ed54452da0aece51a17.jpg',
'https://img-pa.auto1.com/img8c/42/8c4210c2ab719eb423783f62e3aa36a0/pa/RU91332_ef4fac4017596f0e4bd5c13ab3bb2de6.jpg',
'https://img-pa.auto1.com/img8c/42/8c4210c2ab719eb423783f62e3aa36a0/pa/RU91332_5686960cb5083203c2f1eb64366d8dde.jpg',
'https://img-pa.auto1.com/img8c/42/8c4210c2ab719eb423783f62e3aa36a0/pa/RU91332_87432a7dbcdf696493484baede6009f5.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be483c22-8d8f-5578-9cc8-5f9e05568bf3/be483c22-8d8f-5578-9cc8-5f9e05568bf3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83338,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/42/8c4210c2ab719eb423783f62e3aa36a0/pa/RU91332_c073ad40ca20cdafacb433a604fc1e08.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be483c22-8d8f-5578-9cc8-5f9e05568bf3/be483c22-8d8f-5578-9cc8-5f9e05568bf3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79106,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/42/8c4210c2ab719eb423783f62e3aa36a0/pa/RU91332_4adaadfdcea3c924f95fd259c3137a53.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be483c22-8d8f-5578-9cc8-5f9e05568bf3/be483c22-8d8f-5578-9cc8-5f9e05568bf3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61070,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/42/8c4210c2ab719eb423783f62e3aa36a0/pa/RU91332_1fcf614e09d60ed54452da0aece51a17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be483c22-8d8f-5578-9cc8-5f9e05568bf3/be483c22-8d8f-5578-9cc8-5f9e05568bf3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75570,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/42/8c4210c2ab719eb423783f62e3aa36a0/pa/RU91332_ef4fac4017596f0e4bd5c13ab3bb2de6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be483c22-8d8f-5578-9cc8-5f9e05568bf3/be483c22-8d8f-5578-9cc8-5f9e05568bf3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84210,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/42/8c4210c2ab719eb423783f62e3aa36a0/pa/RU91332_5686960cb5083203c2f1eb64366d8dde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be483c22-8d8f-5578-9cc8-5f9e05568bf3/be483c22-8d8f-5578-9cc8-5f9e05568bf3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41209,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/42/8c4210c2ab719eb423783f62e3aa36a0/pa/RU91332_87432a7dbcdf696493484baede6009f5.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-12-29',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 2.0 dCi GT',
'transmission': 'manual',
'trim': 'GT',
'year': 2010}
2026-03-30 11:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU91332%27 HTTP/1.1" 200 None
2026-03-30 11:22:26 [auto1.fr] INFO: Saving data for RU91332: {'created_time': 1774869746.098534, 'last_price_update_time': 1774869746.098545, 'auction_closing_time': 1774972230.0}
2026-03-30 11:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RU91332') HTTP/1.1" 204 0
2026-03-30 11:22:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384e8090>
2026-03-30 11:22:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2199f46b-6f15-5664-991d-4814ef470396/2199f46b-6f15-5664-991d-4814ef470396_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F1a%252F3e1a17b2f851ebf2d366e056f1b822b7%252Fpa%252FSA42500_d9d3292533f59ba4c82f8a973c882ef5.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_d9d3292533f59ba4c82f8a973c882ef5.jpg saved to cache
2026-03-30 11:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2199f46b-6f15-5664-991d-4814ef470396
2026-03-30 11:22:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2199f46b-6f15-5664-991d-4814ef470396, skipping ID generation
2026-03-30 11:22:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2199f46b-6f15-5664-991d-4814ef470396 with scrape type 1
2026-03-30 11:22:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2199f46b-6f15-5664-991d-4814ef470396 sending to next pipeline
2026-03-30 11:22:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2199f46b-6f15-5664-991d-4814ef470396, identifier: SA42500
2026-03-30 11:22:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2199f46b-6f15-5664-991d-4814ef470396 with identifier: SA42500
2026-03-30 11:22:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2199f46b-6f15-5664-991d-4814ef470396 with identifier: SA42500
2026-03-30 11:22:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2199f46b-6f15-5664-991d-4814ef470396 with identifier: SA42500 to the API
2026-03-30 11:22:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_d9d3292533f59ba4c82f8a973c882ef5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 154,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:24:18Z',
'fuel_type': 'diesel',
'id': '2199f46b-6f15-5664-991d-4814ef470396',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA42500',
'listing': 'auction',
'location': 'FR, Metz',
'make': 'Peugeot',
'model': '5008',
'odometer': 329905,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2199f46b-6f15-5664-991d-4814ef470396/2199f46b-6f15-5664-991d-4814ef470396_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82069,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_d9d3292533f59ba4c82f8a973c882ef5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2199f46b-6f15-5664-991d-4814ef470396/2199f46b-6f15-5664-991d-4814ef470396_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85316,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_36dad7e4144193ca575167cb6fdd3ff1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2199f46b-6f15-5664-991d-4814ef470396/2199f46b-6f15-5664-991d-4814ef470396_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76795,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_979464914e119065ae05e322b06dec3f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2199f46b-6f15-5664-991d-4814ef470396/2199f46b-6f15-5664-991d-4814ef470396_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78047,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_fb5e50d988678fd79f3555fa1f411a4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2199f46b-6f15-5664-991d-4814ef470396/2199f46b-6f15-5664-991d-4814ef470396_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114497,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_10a37abcfc7202916adeb22fa9f83167.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2199f46b-6f15-5664-991d-4814ef470396/2199f46b-6f15-5664-991d-4814ef470396_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54407,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/1a/3e1a17b2f851ebf2d366e056f1b822b7/pa/SA42500_b32a9821efb4c261c6e9f2b07a4d805d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-08-17',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 5008 2.0 HDi Premium Pack',
'transmission': 'manual',
'trim': 'Premium Pack',
'year': 2011}
2026-03-30 11:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SA42500%27 HTTP/1.1" 200 None
2026-03-30 11:22:26 [auto1.fr] INFO: Saving data for SA42500: {'created_time': 1774869746.642428, 'last_price_update_time': 1774869746.642439, 'auction_closing_time': 1774970658.0}
2026-03-30 11:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SA42500') HTTP/1.1" 204 0
2026-03-30 11:22:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU12813/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XB50119> (referer: https://www.auto1.com/v1/car-details-view/XB50119/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea3d06d4-8a30-5867-b3c1-65ace5c4845c with identifier: XB50119
2026-03-30 11:22:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea3d06d4-8a30-5867-b3c1-65ace5c4845c with scrape type 1
2026-03-30 11:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea3d06d4-8a30-5867-b3c1-65ace5c4845c
2026-03-30 11:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F9d%252F0c9d67b2d49b54ab3a6df4a869d9a5fc%252Fpa%252FXB50119_b7986eacf72ff240d2bcd4ebf87da032.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_b7986eacf72ff240d2bcd4ebf87da032.jpg not downloaded yet
2026-03-30 11:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F9d%252F0c9d67b2d49b54ab3a6df4a869d9a5fc%252Fpa%252FXB50119_bbccf82c9f0fb013cc7f819303ac4e71.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_bbccf82c9f0fb013cc7f819303ac4e71.jpg not downloaded yet
2026-03-30 11:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F9d%252F0c9d67b2d49b54ab3a6df4a869d9a5fc%252Fpa%252FXB50119_3ebdf43ef89ccfc702057e1c7d2c048e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_3ebdf43ef89ccfc702057e1c7d2c048e.jpg not downloaded yet
2026-03-30 11:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F9d%252F0c9d67b2d49b54ab3a6df4a869d9a5fc%252Fpa%252FXB50119_ddd81b2855f85742eb68994908f6a0d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_ddd81b2855f85742eb68994908f6a0d6.jpg not downloaded yet
2026-03-30 11:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F9d%252F0c9d67b2d49b54ab3a6df4a869d9a5fc%252Fpa%252FXB50119_c2f6030c52786a0aceaa5dfa8e205c88.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_c2f6030c52786a0aceaa5dfa8e205c88.jpg not downloaded yet
2026-03-30 11:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F9d%252F0c9d67b2d49b54ab3a6df4a869d9a5fc%252Fpa%252FXB50119_e1baf9ae25bf5394fbe1114ac907d625.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_e1baf9ae25bf5394fbe1114ac907d625.jpg not downloaded yet
2026-03-30 11:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F9d%252F0c9d67b2d49b54ab3a6df4a869d9a5fc%252Fpa%252FXB50119_37631c713f12ab97ec5f75285eeb4515.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_37631c713f12ab97ec5f75285eeb4515.jpg not downloaded yet
2026-03-30 11:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F9d%252F0c9d67b2d49b54ab3a6df4a869d9a5fc%252Fpa%252FXB50119_46f559be03761ee4ebeaa4aaf511d512.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_46f559be03761ee4ebeaa4aaf511d512.jpg not downloaded yet
2026-03-30 11:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F9d%252F0c9d67b2d49b54ab3a6df4a869d9a5fc%252Fpa%252FXB50119_a5629f8f32c7cc86e91f6eb52e19243a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_a5629f8f32c7cc86e91f6eb52e19243a.jpg not downloaded yet
2026-03-30 11:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F9d%252F0c9d67b2d49b54ab3a6df4a869d9a5fc%252Fpa%252FXB50119_f23eb0647b9efd4b7d0f0edaff02c715.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_f23eb0647b9efd4b7d0f0edaff02c715.jpg not downloaded yet
2026-03-30 11:22:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YW96620> (referer: https://www.auto1.com/v1/car-details-view/YW96620/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_f23eb0647b9efd4b7d0f0edaff02c715.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13c51da9-4485-533b-8a7f-5fc647140c9c with identifier: YW96620
2026-03-30 11:22:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13c51da9-4485-533b-8a7f-5fc647140c9c with scrape type 1
2026-03-30 11:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 13c51da9-4485-533b-8a7f-5fc647140c9c
2026-03-30 11:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fe1%252F58e18fd0fcdef0ac6a9fc1725ed5e6b4%252Fpa%252FYW96620_bc882b1373a8c1e300f520577fcccde7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e1/58e18fd0fcdef0ac6a9fc1725ed5e6b4/pa/YW96620_bc882b1373a8c1e300f520577fcccde7.jpg already downloaded
2026-03-30 11:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fe1%252F58e18fd0fcdef0ac6a9fc1725ed5e6b4%252Fpa%252FYW96620_f7c6b23fec844e57ecb15b2b32893815.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e1/58e18fd0fcdef0ac6a9fc1725ed5e6b4/pa/YW96620_f7c6b23fec844e57ecb15b2b32893815.jpg already downloaded
2026-03-30 11:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fe1%252F58e18fd0fcdef0ac6a9fc1725ed5e6b4%252Fpa%252FYW96620_941df0156d1e9cdcc841e1bda08274bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e1/58e18fd0fcdef0ac6a9fc1725ed5e6b4/pa/YW96620_941df0156d1e9cdcc841e1bda08274bd.jpg already downloaded
2026-03-30 11:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fe1%252F58e18fd0fcdef0ac6a9fc1725ed5e6b4%252Fpa%252FYW96620_bab5163ad0e9b1f8782a6727cbb5eb09.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e1/58e18fd0fcdef0ac6a9fc1725ed5e6b4/pa/YW96620_bab5163ad0e9b1f8782a6727cbb5eb09.jpg already downloaded
2026-03-30 11:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fe1%252F58e18fd0fcdef0ac6a9fc1725ed5e6b4%252Fpa%252FYW96620_b3d83b53f3c2f7db7bde8100c8120815.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e1/58e18fd0fcdef0ac6a9fc1725ed5e6b4/pa/YW96620_b3d83b53f3c2f7db7bde8100c8120815.jpg already downloaded
2026-03-30 11:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fe1%252F58e18fd0fcdef0ac6a9fc1725ed5e6b4%252Fpa%252FYW96620_910a63c01c3cb00513db494c125cee0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e1/58e18fd0fcdef0ac6a9fc1725ed5e6b4/pa/YW96620_910a63c01c3cb00513db494c125cee0f.jpg already downloaded
2026-03-30 11:22:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 13c51da9-4485-533b-8a7f-5fc647140c9c, identifier: YW96620
2026-03-30 11:22:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_a5629f8f32c7cc86e91f6eb52e19243a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 13c51da9-4485-533b-8a7f-5fc647140c9c with identifier: YW96620
2026-03-30 11:22:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 13c51da9-4485-533b-8a7f-5fc647140c9c with identifier: YW96620
2026-03-30 11:22:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 13c51da9-4485-533b-8a7f-5fc647140c9c with identifier: YW96620 to the API
2026-03-30 11:22:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YW96620>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:30:41Z',
'fuel_type': 'diesel',
'id': '13c51da9-4485-533b-8a7f-5fc647140c9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW96620',
'listing': 'auction',
'location': 'FR, Le Cellier',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 193970,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img58/e1/58e18fd0fcdef0ac6a9fc1725ed5e6b4/pa/YW96620_bc882b1373a8c1e300f520577fcccde7.jpg',
'https://img-pa.auto1.com/img58/e1/58e18fd0fcdef0ac6a9fc1725ed5e6b4/pa/YW96620_f7c6b23fec844e57ecb15b2b32893815.jpg',
'https://img-pa.auto1.com/img58/e1/58e18fd0fcdef0ac6a9fc1725ed5e6b4/pa/YW96620_941df0156d1e9cdcc841e1bda08274bd.jpg',
'https://img-pa.auto1.com/img58/e1/58e18fd0fcdef0ac6a9fc1725ed5e6b4/pa/YW96620_bab5163ad0e9b1f8782a6727cbb5eb09.jpg',
'https://img-pa.auto1.com/img58/e1/58e18fd0fcdef0ac6a9fc1725ed5e6b4/pa/YW96620_b3d83b53f3c2f7db7bde8100c8120815.jpg',
'https://img-pa.auto1.com/img58/e1/58e18fd0fcdef0ac6a9fc1725ed5e6b4/pa/YW96620_910a63c01c3cb00513db494c125cee0f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c51da9-4485-533b-8a7f-5fc647140c9c/13c51da9-4485-533b-8a7f-5fc647140c9c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107384,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e1/58e18fd0fcdef0ac6a9fc1725ed5e6b4/pa/YW96620_bc882b1373a8c1e300f520577fcccde7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c51da9-4485-533b-8a7f-5fc647140c9c/13c51da9-4485-533b-8a7f-5fc647140c9c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110362,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e1/58e18fd0fcdef0ac6a9fc1725ed5e6b4/pa/YW96620_f7c6b23fec844e57ecb15b2b32893815.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c51da9-4485-533b-8a7f-5fc647140c9c/13c51da9-4485-533b-8a7f-5fc647140c9c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96531,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e1/58e18fd0fcdef0ac6a9fc1725ed5e6b4/pa/YW96620_941df0156d1e9cdcc841e1bda08274bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c51da9-4485-533b-8a7f-5fc647140c9c/13c51da9-4485-533b-8a7f-5fc647140c9c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78019,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e1/58e18fd0fcdef0ac6a9fc1725ed5e6b4/pa/YW96620_bab5163ad0e9b1f8782a6727cbb5eb09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c51da9-4485-533b-8a7f-5fc647140c9c/13c51da9-4485-533b-8a7f-5fc647140c9c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75215,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e1/58e18fd0fcdef0ac6a9fc1725ed5e6b4/pa/YW96620_b3d83b53f3c2f7db7bde8100c8120815.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c51da9-4485-533b-8a7f-5fc647140c9c/13c51da9-4485-533b-8a7f-5fc647140c9c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40337,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e1/58e18fd0fcdef0ac6a9fc1725ed5e6b4/pa/YW96620_910a63c01c3cb00513db494c125cee0f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-07-29',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 200 CDI Design',
'transmission': 'automatic',
'trim': 'Design',
'year': 2008}
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YW96620%27 HTTP/1.1" 200 None
2026-03-30 11:22:31 [auto1.fr] INFO: Saving data for YW96620: {'created_time': 1774869751.512583, 'last_price_update_time': 1774869751.512598, 'auction_closing_time': 1774971041.0}
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YW96620') HTTP/1.1" 204 0
2026-03-30 11:22:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP12773/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383f2dd0>
2026-03-30 11:22:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3d06d4-8a30-5867-b3c1-65ace5c4845c/ea3d06d4-8a30-5867-b3c1-65ace5c4845c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F9d%252F0c9d67b2d49b54ab3a6df4a869d9a5fc%252Fpa%252FXB50119_f23eb0647b9efd4b7d0f0edaff02c715.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_f23eb0647b9efd4b7d0f0edaff02c715.jpg saved to cache
2026-03-30 11:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ea3d06d4-8a30-5867-b3c1-65ace5c4845c
2026-03-30 11:22:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073878a790>
2026-03-30 11:22:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3d06d4-8a30-5867-b3c1-65ace5c4845c/ea3d06d4-8a30-5867-b3c1-65ace5c4845c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F9d%252F0c9d67b2d49b54ab3a6df4a869d9a5fc%252Fpa%252FXB50119_a5629f8f32c7cc86e91f6eb52e19243a.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_a5629f8f32c7cc86e91f6eb52e19243a.jpg saved to cache
2026-03-30 11:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea3d06d4-8a30-5867-b3c1-65ace5c4845c
2026-03-30 11:22:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_46f559be03761ee4ebeaa4aaf511d512.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_37631c713f12ab97ec5f75285eeb4515.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_e1baf9ae25bf5394fbe1114ac907d625.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385ab710>
2026-03-30 11:22:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3d06d4-8a30-5867-b3c1-65ace5c4845c/ea3d06d4-8a30-5867-b3c1-65ace5c4845c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F9d%252F0c9d67b2d49b54ab3a6df4a869d9a5fc%252Fpa%252FXB50119_46f559be03761ee4ebeaa4aaf511d512.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_46f559be03761ee4ebeaa4aaf511d512.jpg saved to cache
2026-03-30 11:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea3d06d4-8a30-5867-b3c1-65ace5c4845c
2026-03-30 11:22:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_c2f6030c52786a0aceaa5dfa8e205c88.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384e5910>
2026-03-30 11:22:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3d06d4-8a30-5867-b3c1-65ace5c4845c/ea3d06d4-8a30-5867-b3c1-65ace5c4845c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F9d%252F0c9d67b2d49b54ab3a6df4a869d9a5fc%252Fpa%252FXB50119_37631c713f12ab97ec5f75285eeb4515.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_37631c713f12ab97ec5f75285eeb4515.jpg saved to cache
2026-03-30 11:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea3d06d4-8a30-5867-b3c1-65ace5c4845c
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07393f47d0>
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3d06d4-8a30-5867-b3c1-65ace5c4845c/ea3d06d4-8a30-5867-b3c1-65ace5c4845c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F9d%252F0c9d67b2d49b54ab3a6df4a869d9a5fc%252Fpa%252FXB50119_e1baf9ae25bf5394fbe1114ac907d625.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_e1baf9ae25bf5394fbe1114ac907d625.jpg saved to cache
2026-03-30 11:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea3d06d4-8a30-5867-b3c1-65ace5c4845c
2026-03-30 11:22:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_ddd81b2855f85742eb68994908f6a0d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738687690>
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3d06d4-8a30-5867-b3c1-65ace5c4845c/ea3d06d4-8a30-5867-b3c1-65ace5c4845c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F9d%252F0c9d67b2d49b54ab3a6df4a869d9a5fc%252Fpa%252FXB50119_c2f6030c52786a0aceaa5dfa8e205c88.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_c2f6030c52786a0aceaa5dfa8e205c88.jpg saved to cache
2026-03-30 11:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea3d06d4-8a30-5867-b3c1-65ace5c4845c
2026-03-30 11:22:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_3ebdf43ef89ccfc702057e1c7d2c048e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383a9ed0>
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3d06d4-8a30-5867-b3c1-65ace5c4845c/ea3d06d4-8a30-5867-b3c1-65ace5c4845c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F9d%252F0c9d67b2d49b54ab3a6df4a869d9a5fc%252Fpa%252FXB50119_ddd81b2855f85742eb68994908f6a0d6.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_ddd81b2855f85742eb68994908f6a0d6.jpg saved to cache
2026-03-30 11:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea3d06d4-8a30-5867-b3c1-65ace5c4845c
2026-03-30 11:22:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_bbccf82c9f0fb013cc7f819303ac4e71.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385abc90>
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3d06d4-8a30-5867-b3c1-65ace5c4845c/ea3d06d4-8a30-5867-b3c1-65ace5c4845c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F9d%252F0c9d67b2d49b54ab3a6df4a869d9a5fc%252Fpa%252FXB50119_3ebdf43ef89ccfc702057e1c7d2c048e.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_3ebdf43ef89ccfc702057e1c7d2c048e.jpg saved to cache
2026-03-30 11:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea3d06d4-8a30-5867-b3c1-65ace5c4845c
2026-03-30 11:22:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_b7986eacf72ff240d2bcd4ebf87da032.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PW51275/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383c06d0>
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3d06d4-8a30-5867-b3c1-65ace5c4845c/ea3d06d4-8a30-5867-b3c1-65ace5c4845c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F9d%252F0c9d67b2d49b54ab3a6df4a869d9a5fc%252Fpa%252FXB50119_bbccf82c9f0fb013cc7f819303ac4e71.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_bbccf82c9f0fb013cc7f819303ac4e71.jpg saved to cache
2026-03-30 11:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea3d06d4-8a30-5867-b3c1-65ace5c4845c
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384d4650>
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea3d06d4-8a30-5867-b3c1-65ace5c4845c/ea3d06d4-8a30-5867-b3c1-65ace5c4845c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F9d%252F0c9d67b2d49b54ab3a6df4a869d9a5fc%252Fpa%252FXB50119_b7986eacf72ff240d2bcd4ebf87da032.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_b7986eacf72ff240d2bcd4ebf87da032.jpg saved to cache
2026-03-30 11:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea3d06d4-8a30-5867-b3c1-65ace5c4845c
2026-03-30 11:22:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea3d06d4-8a30-5867-b3c1-65ace5c4845c, skipping ID generation
2026-03-30 11:22:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea3d06d4-8a30-5867-b3c1-65ace5c4845c with scrape type 1
2026-03-30 11:22:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea3d06d4-8a30-5867-b3c1-65ace5c4845c sending to next pipeline
2026-03-30 11:22:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ea3d06d4-8a30-5867-b3c1-65ace5c4845c, identifier: XB50119
2026-03-30 11:22:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ea3d06d4-8a30-5867-b3c1-65ace5c4845c with identifier: XB50119
2026-03-30 11:22:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ea3d06d4-8a30-5867-b3c1-65ace5c4845c with identifier: XB50119
2026-03-30 11:22:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ea3d06d4-8a30-5867-b3c1-65ace5c4845c with identifier: XB50119 to the API
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_b7986eacf72ff240d2bcd4ebf87da032.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 117,
'expiration_date': '2026-03-31T15:16:48Z',
'fuel_type': 'petrol',
'id': 'ea3d06d4-8a30-5867-b3c1-65ace5c4845c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB50119',
'listing': 'auction',
'location': 'FR',
'make': 'Nissan',
'model': 'Juke',
'odometer': 84862,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3d06d4-8a30-5867-b3c1-65ace5c4845c/ea3d06d4-8a30-5867-b3c1-65ace5c4845c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43146,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_b7986eacf72ff240d2bcd4ebf87da032.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3d06d4-8a30-5867-b3c1-65ace5c4845c/ea3d06d4-8a30-5867-b3c1-65ace5c4845c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43146,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_bbccf82c9f0fb013cc7f819303ac4e71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3d06d4-8a30-5867-b3c1-65ace5c4845c/ea3d06d4-8a30-5867-b3c1-65ace5c4845c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37773,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_3ebdf43ef89ccfc702057e1c7d2c048e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3d06d4-8a30-5867-b3c1-65ace5c4845c/ea3d06d4-8a30-5867-b3c1-65ace5c4845c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38759,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_ddd81b2855f85742eb68994908f6a0d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3d06d4-8a30-5867-b3c1-65ace5c4845c/ea3d06d4-8a30-5867-b3c1-65ace5c4845c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_c2f6030c52786a0aceaa5dfa8e205c88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3d06d4-8a30-5867-b3c1-65ace5c4845c/ea3d06d4-8a30-5867-b3c1-65ace5c4845c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44250,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_e1baf9ae25bf5394fbe1114ac907d625.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3d06d4-8a30-5867-b3c1-65ace5c4845c/ea3d06d4-8a30-5867-b3c1-65ace5c4845c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41456,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_37631c713f12ab97ec5f75285eeb4515.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3d06d4-8a30-5867-b3c1-65ace5c4845c/ea3d06d4-8a30-5867-b3c1-65ace5c4845c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114956,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_46f559be03761ee4ebeaa4aaf511d512.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3d06d4-8a30-5867-b3c1-65ace5c4845c/ea3d06d4-8a30-5867-b3c1-65ace5c4845c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62786,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_a5629f8f32c7cc86e91f6eb52e19243a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea3d06d4-8a30-5867-b3c1-65ace5c4845c/ea3d06d4-8a30-5867-b3c1-65ace5c4845c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64064,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/9d/0c9d67b2d49b54ab3a6df4a869d9a5fc/pa/XB50119_f23eb0647b9efd4b7d0f0edaff02c715.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-04-14',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Juke 1.6 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2013}
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB50119%27 HTTP/1.1" 200 None
2026-03-30 11:22:33 [auto1.fr] INFO: Saving data for XB50119: {'created_time': 1774869753.234172, 'last_price_update_time': 1774869753.234188, 'auction_closing_time': 1774970208.0}
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XB50119') HTTP/1.1" 204 0
2026-03-30 11:22:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MV42636/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KA23831> (referer: https://www.auto1.com/v1/car-details-view/KA23831/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c04e9456-3a74-563c-9fec-ac12dcebd45f with identifier: KA23831
2026-03-30 11:22:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c04e9456-3a74-563c-9fec-ac12dcebd45f with scrape type 1
2026-03-30 11:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c04e9456-3a74-563c-9fec-ac12dcebd45f
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fee%252Fd0eea7b44bc45302560b2ac16c20833b%252Fpa%252FKA23831_68993111633d73ddc3ca0f2015169cd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_68993111633d73ddc3ca0f2015169cd0.jpg not downloaded yet
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fee%252Fd0eea7b44bc45302560b2ac16c20833b%252Fpa%252FKA23831_0d3965de661082b2b4c6aaa728303ff9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_0d3965de661082b2b4c6aaa728303ff9.jpg not downloaded yet
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fee%252Fd0eea7b44bc45302560b2ac16c20833b%252Fpa%252FKA23831_c7889f5f3160800267d319851c789a9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_c7889f5f3160800267d319851c789a9b.jpg not downloaded yet
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fee%252Fd0eea7b44bc45302560b2ac16c20833b%252Fpa%252FKA23831_05abf72504df7e1d55455c75114d508b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_05abf72504df7e1d55455c75114d508b.jpg not downloaded yet
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fee%252Fd0eea7b44bc45302560b2ac16c20833b%252Fpa%252FKA23831_8733aa22ccd9ad7da04712cdadf118c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_8733aa22ccd9ad7da04712cdadf118c2.jpg not downloaded yet
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fee%252Fd0eea7b44bc45302560b2ac16c20833b%252Fpa%252FKA23831_af894ee5a71a36ec45c7a99a0062f543.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_af894ee5a71a36ec45c7a99a0062f543.jpg not downloaded yet
2026-03-30 11:22:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_0d3965de661082b2b4c6aaa728303ff9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_68993111633d73ddc3ca0f2015169cd0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fee%252Fd0eea7b44bc45302560b2ac16c20833b%252Fpa%252FKA23831_d5af7329e01112c424a4c99a5bb4c740.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_d5af7329e01112c424a4c99a5bb4c740.jpg not downloaded yet
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fee%252Fd0eea7b44bc45302560b2ac16c20833b%252Fpa%252FKA23831_fd1812f146928b704b14108a4d6b846b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_fd1812f146928b704b14108a4d6b846b.jpg not downloaded yet
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fee%252Fd0eea7b44bc45302560b2ac16c20833b%252Fpa%252FKA23831_e4e1403fb177b18da8692ba9d3c00022.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_e4e1403fb177b18da8692ba9d3c00022.jpg not downloaded yet
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fee%252Fd0eea7b44bc45302560b2ac16c20833b%252Fpa%252FKA23831_b45bfc7aa8238524efd33cc1fadfd18f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_b45bfc7aa8238524efd33cc1fadfd18f.jpg not downloaded yet
2026-03-30 11:22:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383a9bd0>
2026-03-30 11:22:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c04e9456-3a74-563c-9fec-ac12dcebd45f/c04e9456-3a74-563c-9fec-ac12dcebd45f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fee%252Fd0eea7b44bc45302560b2ac16c20833b%252Fpa%252FKA23831_0d3965de661082b2b4c6aaa728303ff9.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_0d3965de661082b2b4c6aaa728303ff9.jpg saved to cache
2026-03-30 11:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c04e9456-3a74-563c-9fec-ac12dcebd45f
2026-03-30 11:22:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385bdf10>
2026-03-30 11:22:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c04e9456-3a74-563c-9fec-ac12dcebd45f/c04e9456-3a74-563c-9fec-ac12dcebd45f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fee%252Fd0eea7b44bc45302560b2ac16c20833b%252Fpa%252FKA23831_68993111633d73ddc3ca0f2015169cd0.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_68993111633d73ddc3ca0f2015169cd0.jpg saved to cache
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c04e9456-3a74-563c-9fec-ac12dcebd45f
2026-03-30 11:22:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_8733aa22ccd9ad7da04712cdadf118c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_af894ee5a71a36ec45c7a99a0062f543.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384b1610>
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c04e9456-3a74-563c-9fec-ac12dcebd45f/c04e9456-3a74-563c-9fec-ac12dcebd45f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fee%252Fd0eea7b44bc45302560b2ac16c20833b%252Fpa%252FKA23831_8733aa22ccd9ad7da04712cdadf118c2.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_8733aa22ccd9ad7da04712cdadf118c2.jpg saved to cache
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c04e9456-3a74-563c-9fec-ac12dcebd45f
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738555350>
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c04e9456-3a74-563c-9fec-ac12dcebd45f/c04e9456-3a74-563c-9fec-ac12dcebd45f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fee%252Fd0eea7b44bc45302560b2ac16c20833b%252Fpa%252FKA23831_af894ee5a71a36ec45c7a99a0062f543.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_af894ee5a71a36ec45c7a99a0062f543.jpg saved to cache
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c04e9456-3a74-563c-9fec-ac12dcebd45f
2026-03-30 11:22:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_b45bfc7aa8238524efd33cc1fadfd18f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_e4e1403fb177b18da8692ba9d3c00022.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384a0510>
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c04e9456-3a74-563c-9fec-ac12dcebd45f/c04e9456-3a74-563c-9fec-ac12dcebd45f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fee%252Fd0eea7b44bc45302560b2ac16c20833b%252Fpa%252FKA23831_b45bfc7aa8238524efd33cc1fadfd18f.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_b45bfc7aa8238524efd33cc1fadfd18f.jpg saved to cache
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c04e9456-3a74-563c-9fec-ac12dcebd45f
2026-03-30 11:22:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN91782> (referer: https://www.auto1.com/v1/car-details-view/JN91782/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738426510>
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c04e9456-3a74-563c-9fec-ac12dcebd45f/c04e9456-3a74-563c-9fec-ac12dcebd45f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fee%252Fd0eea7b44bc45302560b2ac16c20833b%252Fpa%252FKA23831_e4e1403fb177b18da8692ba9d3c00022.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_e4e1403fb177b18da8692ba9d3c00022.jpg saved to cache
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c04e9456-3a74-563c-9fec-ac12dcebd45f
2026-03-30 11:22:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_fd1812f146928b704b14108a4d6b846b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_d5af7329e01112c424a4c99a5bb4c740.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_05abf72504df7e1d55455c75114d508b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088 with identifier: JN91782
2026-03-30 11:22:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088 with scrape type 1
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F6a%252F686ac08919a1c60715bd57dfba2defe4%252Fpa%252FJN91782_80310a3bbb496dcae518c27fa68f9d90.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_80310a3bbb496dcae518c27fa68f9d90.jpg not downloaded yet
2026-03-30 11:22:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_c7889f5f3160800267d319851c789a9b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F6a%252F686ac08919a1c60715bd57dfba2defe4%252Fpa%252FJN91782_781a07e546b1a14a2b7d53039ad8ea2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_781a07e546b1a14a2b7d53039ad8ea2f.jpg not downloaded yet
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F6a%252F686ac08919a1c60715bd57dfba2defe4%252Fpa%252FJN91782_255106258e5fc95b53acfb1727913811.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_255106258e5fc95b53acfb1727913811.jpg not downloaded yet
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F6a%252F686ac08919a1c60715bd57dfba2defe4%252Fpa%252FJN91782_f0a28326536491c0b4cef2a4038990a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_f0a28326536491c0b4cef2a4038990a6.jpg not downloaded yet
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384a5e90>
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c04e9456-3a74-563c-9fec-ac12dcebd45f/c04e9456-3a74-563c-9fec-ac12dcebd45f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fee%252Fd0eea7b44bc45302560b2ac16c20833b%252Fpa%252FKA23831_fd1812f146928b704b14108a4d6b846b.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_fd1812f146928b704b14108a4d6b846b.jpg saved to cache
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c04e9456-3a74-563c-9fec-ac12dcebd45f
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073853f850>
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c04e9456-3a74-563c-9fec-ac12dcebd45f/c04e9456-3a74-563c-9fec-ac12dcebd45f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fee%252Fd0eea7b44bc45302560b2ac16c20833b%252Fpa%252FKA23831_d5af7329e01112c424a4c99a5bb4c740.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_d5af7329e01112c424a4c99a5bb4c740.jpg saved to cache
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c04e9456-3a74-563c-9fec-ac12dcebd45f
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F6a%252F686ac08919a1c60715bd57dfba2defe4%252Fpa%252FJN91782_40126b8cb2a6a134daec55cab50f76da.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_40126b8cb2a6a134daec55cab50f76da.jpg not downloaded yet
2026-03-30 11:22:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_80310a3bbb496dcae518c27fa68f9d90.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_781a07e546b1a14a2b7d53039ad8ea2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F6a%252F686ac08919a1c60715bd57dfba2defe4%252Fpa%252FJN91782_67a96777619768dffe3324e8f6fef52b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_67a96777619768dffe3324e8f6fef52b.jpg not downloaded yet
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738454790>
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c04e9456-3a74-563c-9fec-ac12dcebd45f/c04e9456-3a74-563c-9fec-ac12dcebd45f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fee%252Fd0eea7b44bc45302560b2ac16c20833b%252Fpa%252FKA23831_05abf72504df7e1d55455c75114d508b.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_05abf72504df7e1d55455c75114d508b.jpg saved to cache
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c04e9456-3a74-563c-9fec-ac12dcebd45f
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738544d10>
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c04e9456-3a74-563c-9fec-ac12dcebd45f/c04e9456-3a74-563c-9fec-ac12dcebd45f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fee%252Fd0eea7b44bc45302560b2ac16c20833b%252Fpa%252FKA23831_c7889f5f3160800267d319851c789a9b.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_c7889f5f3160800267d319851c789a9b.jpg saved to cache
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c04e9456-3a74-563c-9fec-ac12dcebd45f
2026-03-30 11:22:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c04e9456-3a74-563c-9fec-ac12dcebd45f, skipping ID generation
2026-03-30 11:22:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c04e9456-3a74-563c-9fec-ac12dcebd45f with scrape type 1
2026-03-30 11:22:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c04e9456-3a74-563c-9fec-ac12dcebd45f sending to next pipeline
2026-03-30 11:22:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c04e9456-3a74-563c-9fec-ac12dcebd45f, identifier: KA23831
2026-03-30 11:22:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c04e9456-3a74-563c-9fec-ac12dcebd45f with identifier: KA23831
2026-03-30 11:22:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c04e9456-3a74-563c-9fec-ac12dcebd45f with identifier: KA23831
2026-03-30 11:22:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c04e9456-3a74-563c-9fec-ac12dcebd45f with identifier: KA23831 to the API
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_c7889f5f3160800267d319851c789a9b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:34:10Z',
'fuel_type': 'diesel',
'id': 'c04e9456-3a74-563c-9fec-ac12dcebd45f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA23831',
'listing': 'auction',
'location': 'FR, Saint-Malo',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 81270,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04e9456-3a74-563c-9fec-ac12dcebd45f/c04e9456-3a74-563c-9fec-ac12dcebd45f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60647,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_68993111633d73ddc3ca0f2015169cd0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04e9456-3a74-563c-9fec-ac12dcebd45f/c04e9456-3a74-563c-9fec-ac12dcebd45f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_0d3965de661082b2b4c6aaa728303ff9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04e9456-3a74-563c-9fec-ac12dcebd45f/c04e9456-3a74-563c-9fec-ac12dcebd45f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58318,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_c7889f5f3160800267d319851c789a9b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04e9456-3a74-563c-9fec-ac12dcebd45f/c04e9456-3a74-563c-9fec-ac12dcebd45f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52087,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_05abf72504df7e1d55455c75114d508b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04e9456-3a74-563c-9fec-ac12dcebd45f/c04e9456-3a74-563c-9fec-ac12dcebd45f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61921,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_8733aa22ccd9ad7da04712cdadf118c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04e9456-3a74-563c-9fec-ac12dcebd45f/c04e9456-3a74-563c-9fec-ac12dcebd45f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67747,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_af894ee5a71a36ec45c7a99a0062f543.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04e9456-3a74-563c-9fec-ac12dcebd45f/c04e9456-3a74-563c-9fec-ac12dcebd45f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_d5af7329e01112c424a4c99a5bb4c740.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04e9456-3a74-563c-9fec-ac12dcebd45f/c04e9456-3a74-563c-9fec-ac12dcebd45f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64640,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_fd1812f146928b704b14108a4d6b846b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04e9456-3a74-563c-9fec-ac12dcebd45f/c04e9456-3a74-563c-9fec-ac12dcebd45f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67218,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_e4e1403fb177b18da8692ba9d3c00022.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04e9456-3a74-563c-9fec-ac12dcebd45f/c04e9456-3a74-563c-9fec-ac12dcebd45f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58928,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/ee/d0eea7b44bc45302560b2ac16c20833b/pa/KA23831_b45bfc7aa8238524efd33cc1fadfd18f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-13',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2019}
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA23831%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.fr] INFO: Saving data for KA23831: {'created_time': 1774869760.42878, 'last_price_update_time': 1774869760.428795, 'auction_closing_time': 1774971250.0}
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KA23831') HTTP/1.1" 204 0
2026-03-30 11:22:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_255106258e5fc95b53acfb1727913811.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F6a%252F686ac08919a1c60715bd57dfba2defe4%252Fpa%252FJN91782_28f452e84027675888190e9453609375.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_28f452e84027675888190e9453609375.jpg not downloaded yet
2026-03-30 11:22:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385be410>
2026-03-30 11:22:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088/9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F6a%252F686ac08919a1c60715bd57dfba2defe4%252Fpa%252FJN91782_80310a3bbb496dcae518c27fa68f9d90.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_80310a3bbb496dcae518c27fa68f9d90.jpg saved to cache
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088
2026-03-30 11:22:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a7e3cd0>
2026-03-30 11:22:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088/9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F6a%252F686ac08919a1c60715bd57dfba2defe4%252Fpa%252FJN91782_781a07e546b1a14a2b7d53039ad8ea2f.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_781a07e546b1a14a2b7d53039ad8ea2f.jpg saved to cache
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F6a%252F686ac08919a1c60715bd57dfba2defe4%252Fpa%252FJN91782_1c4bcb7b48dd8ceaab35d97efd227f2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_1c4bcb7b48dd8ceaab35d97efd227f2f.jpg not downloaded yet
2026-03-30 11:22:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AS36340> (referer: https://www.auto1.com/v1/car-details-view/AS36340/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F6a%252F686ac08919a1c60715bd57dfba2defe4%252Fpa%252FJN91782_19dca76b174c5d27e418fd70973aae64.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_19dca76b174c5d27e418fd70973aae64.jpg not downloaded yet
2026-03-30 11:22:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073849cd90>
2026-03-30 11:22:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088/9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F6a%252F686ac08919a1c60715bd57dfba2defe4%252Fpa%252FJN91782_255106258e5fc95b53acfb1727913811.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_255106258e5fc95b53acfb1727913811.jpg saved to cache
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088
2026-03-30 11:22:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_40126b8cb2a6a134daec55cab50f76da.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_f0a28326536491c0b4cef2a4038990a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F6a%252F686ac08919a1c60715bd57dfba2defe4%252Fpa%252FJN91782_49661fa6e1630cc810a1649e87c9044a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_49661fa6e1630cc810a1649e87c9044a.jpg not downloaded yet
2026-03-30 11:22:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8995443d-5e42-5081-8645-48dcb516bc48 with identifier: AS36340
2026-03-30 11:22:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8995443d-5e42-5081-8645-48dcb516bc48 with scrape type 1
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8995443d-5e42-5081-8645-48dcb516bc48
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaad0baf81e0f68f748129b8713909f%252Fpa%252FAS36340_82dd4fbebfcc8fe6cb4f13b52250ddbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_82dd4fbebfcc8fe6cb4f13b52250ddbb.jpg not downloaded yet
2026-03-30 11:22:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_28f452e84027675888190e9453609375.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaad0baf81e0f68f748129b8713909f%252Fpa%252FAS36340_80a52e735525676f6cb790e286029a2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_80a52e735525676f6cb790e286029a2a.jpg not downloaded yet
2026-03-30 11:22:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_67a96777619768dffe3324e8f6fef52b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_1c4bcb7b48dd8ceaab35d97efd227f2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_19dca76b174c5d27e418fd70973aae64.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaad0baf81e0f68f748129b8713909f%252Fpa%252FAS36340_b4ba4ca10951281b096f520c5a1fc1d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_b4ba4ca10951281b096f520c5a1fc1d8.jpg not downloaded yet
2026-03-30 11:22:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738430210>
2026-03-30 11:22:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088/9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F6a%252F686ac08919a1c60715bd57dfba2defe4%252Fpa%252FJN91782_40126b8cb2a6a134daec55cab50f76da.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_40126b8cb2a6a134daec55cab50f76da.jpg saved to cache
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088
2026-03-30 11:22:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384ace50>
2026-03-30 11:22:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088/9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F6a%252F686ac08919a1c60715bd57dfba2defe4%252Fpa%252FJN91782_f0a28326536491c0b4cef2a4038990a6.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_f0a28326536491c0b4cef2a4038990a6.jpg saved to cache
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaad0baf81e0f68f748129b8713909f%252Fpa%252FAS36340_5188c4271221582c07f09a7d2d2b0ffa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_5188c4271221582c07f09a7d2d2b0ffa.jpg not downloaded yet
2026-03-30 11:22:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_49661fa6e1630cc810a1649e87c9044a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_82dd4fbebfcc8fe6cb4f13b52250ddbb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaad0baf81e0f68f748129b8713909f%252Fpa%252FAS36340_36b8ac74d5a032f6f7d72764038c375d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_36b8ac74d5a032f6f7d72764038c375d.jpg not downloaded yet
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073859ebd0>
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088/9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F6a%252F686ac08919a1c60715bd57dfba2defe4%252Fpa%252FJN91782_28f452e84027675888190e9453609375.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_28f452e84027675888190e9453609375.jpg saved to cache
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738429090>
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088/9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F6a%252F686ac08919a1c60715bd57dfba2defe4%252Fpa%252FJN91782_67a96777619768dffe3324e8f6fef52b.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_67a96777619768dffe3324e8f6fef52b.jpg saved to cache
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738544890>
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088/9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F6a%252F686ac08919a1c60715bd57dfba2defe4%252Fpa%252FJN91782_1c4bcb7b48dd8ceaab35d97efd227f2f.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_1c4bcb7b48dd8ceaab35d97efd227f2f.jpg saved to cache
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384c9750>
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088/9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F6a%252F686ac08919a1c60715bd57dfba2defe4%252Fpa%252FJN91782_19dca76b174c5d27e418fd70973aae64.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_19dca76b174c5d27e418fd70973aae64.jpg saved to cache
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaad0baf81e0f68f748129b8713909f%252Fpa%252FAS36340_6d5675a850ab5e5ab6ad34d6a365caa9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_6d5675a850ab5e5ab6ad34d6a365caa9.jpg not downloaded yet
2026-03-30 11:22:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_80a52e735525676f6cb790e286029a2a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_b4ba4ca10951281b096f520c5a1fc1d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaad0baf81e0f68f748129b8713909f%252Fpa%252FAS36340_1a80943e005b38bfab7b08b6158e2f63.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_1a80943e005b38bfab7b08b6158e2f63.jpg not downloaded yet
2026-03-30 11:22:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CX62524/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738546a10>
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088/9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F6a%252F686ac08919a1c60715bd57dfba2defe4%252Fpa%252FJN91782_49661fa6e1630cc810a1649e87c9044a.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_49661fa6e1630cc810a1649e87c9044a.jpg saved to cache
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088
2026-03-30 11:22:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088, skipping ID generation
2026-03-30 11:22:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088 with scrape type 1
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088 sending to next pipeline
2026-03-30 11:22:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088, identifier: JN91782
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738536ed0>
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8995443d-5e42-5081-8645-48dcb516bc48/8995443d-5e42-5081-8645-48dcb516bc48_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaad0baf81e0f68f748129b8713909f%252Fpa%252FAS36340_82dd4fbebfcc8fe6cb4f13b52250ddbb.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_82dd4fbebfcc8fe6cb4f13b52250ddbb.jpg saved to cache
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8995443d-5e42-5081-8645-48dcb516bc48
2026-03-30 11:22:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_5188c4271221582c07f09a7d2d2b0ffa.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaad0baf81e0f68f748129b8713909f%252Fpa%252FAS36340_1b2f30b25e2cff9dc31e754346e7a51c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_1b2f30b25e2cff9dc31e754346e7a51c.jpg not downloaded yet
2026-03-30 11:22:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088 with identifier: JN91782
2026-03-30 11:22:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088 with identifier: JN91782
2026-03-30 11:22:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088 with identifier: JN91782 to the API
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_49661fa6e1630cc810a1649e87c9044a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:08:43Z',
'fuel_type': 'diesel',
'id': '9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN91782',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Renault',
'model': 'Captur',
'odometer': 224682,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088/9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44150,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_80310a3bbb496dcae518c27fa68f9d90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088/9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_781a07e546b1a14a2b7d53039ad8ea2f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088/9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_255106258e5fc95b53acfb1727913811.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088/9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40269,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_f0a28326536491c0b4cef2a4038990a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088/9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_40126b8cb2a6a134daec55cab50f76da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088/9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41133,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_67a96777619768dffe3324e8f6fef52b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088/9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_28f452e84027675888190e9453609375.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088/9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91344,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_1c4bcb7b48dd8ceaab35d97efd227f2f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088/9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_19dca76b174c5d27e418fd70973aae64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088/9a3aad4d-fe2a-52b5-9ba0-e3cb72f2f088_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64651,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/6a/686ac08919a1c60715bd57dfba2defe4/pa/JN91782_49661fa6e1630cc810a1649e87c9044a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-12-18',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.5 dCi Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2013}
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN91782%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [auto1.fr] INFO: Saving data for JN91782: {'created_time': 1774869761.994311, 'last_price_update_time': 1774869761.994322, 'auction_closing_time': 1774969723.0}
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JN91782') HTTP/1.1" 204 0
2026-03-30 11:22:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_36b8ac74d5a032f6f7d72764038c375d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaad0baf81e0f68f748129b8713909f%252Fpa%252FAS36340_ed709c6aba1cb98b65897c00bc077482.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_ed709c6aba1cb98b65897c00bc077482.jpg not downloaded yet
2026-03-30 11:22:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA64429/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_6d5675a850ab5e5ab6ad34d6a365caa9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738544750>
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8995443d-5e42-5081-8645-48dcb516bc48/8995443d-5e42-5081-8645-48dcb516bc48_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaad0baf81e0f68f748129b8713909f%252Fpa%252FAS36340_80a52e735525676f6cb790e286029a2a.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_80a52e735525676f6cb790e286029a2a.jpg saved to cache
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8995443d-5e42-5081-8645-48dcb516bc48
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384bb090>
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8995443d-5e42-5081-8645-48dcb516bc48/8995443d-5e42-5081-8645-48dcb516bc48_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaad0baf81e0f68f748129b8713909f%252Fpa%252FAS36340_b4ba4ca10951281b096f520c5a1fc1d8.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_b4ba4ca10951281b096f520c5a1fc1d8.jpg saved to cache
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8995443d-5e42-5081-8645-48dcb516bc48
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385bf4d0>
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8995443d-5e42-5081-8645-48dcb516bc48/8995443d-5e42-5081-8645-48dcb516bc48_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaad0baf81e0f68f748129b8713909f%252Fpa%252FAS36340_5188c4271221582c07f09a7d2d2b0ffa.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_5188c4271221582c07f09a7d2d2b0ffa.jpg saved to cache
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8995443d-5e42-5081-8645-48dcb516bc48
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaad0baf81e0f68f748129b8713909f%252Fpa%252FAS36340_705d0c02272d26a6bfef9c0f7f33d95a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_705d0c02272d26a6bfef9c0f7f33d95a.jpg not downloaded yet
2026-03-30 11:22:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_1a80943e005b38bfab7b08b6158e2f63.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384c57d0>
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8995443d-5e42-5081-8645-48dcb516bc48/8995443d-5e42-5081-8645-48dcb516bc48_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaad0baf81e0f68f748129b8713909f%252Fpa%252FAS36340_36b8ac74d5a032f6f7d72764038c375d.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_36b8ac74d5a032f6f7d72764038c375d.jpg saved to cache
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8995443d-5e42-5081-8645-48dcb516bc48
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383fc690>
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8995443d-5e42-5081-8645-48dcb516bc48/8995443d-5e42-5081-8645-48dcb516bc48_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaad0baf81e0f68f748129b8713909f%252Fpa%252FAS36340_6d5675a850ab5e5ab6ad34d6a365caa9.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_6d5675a850ab5e5ab6ad34d6a365caa9.jpg saved to cache
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8995443d-5e42-5081-8645-48dcb516bc48
2026-03-30 11:22:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_1b2f30b25e2cff9dc31e754346e7a51c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_ed709c6aba1cb98b65897c00bc077482.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738722c50>
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8995443d-5e42-5081-8645-48dcb516bc48/8995443d-5e42-5081-8645-48dcb516bc48_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaad0baf81e0f68f748129b8713909f%252Fpa%252FAS36340_1a80943e005b38bfab7b08b6158e2f63.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_1a80943e005b38bfab7b08b6158e2f63.jpg saved to cache
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8995443d-5e42-5081-8645-48dcb516bc48
2026-03-30 11:22:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_705d0c02272d26a6bfef9c0f7f33d95a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384b0350>
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8995443d-5e42-5081-8645-48dcb516bc48/8995443d-5e42-5081-8645-48dcb516bc48_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaad0baf81e0f68f748129b8713909f%252Fpa%252FAS36340_1b2f30b25e2cff9dc31e754346e7a51c.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_1b2f30b25e2cff9dc31e754346e7a51c.jpg saved to cache
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8995443d-5e42-5081-8645-48dcb516bc48
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738720fd0>
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8995443d-5e42-5081-8645-48dcb516bc48/8995443d-5e42-5081-8645-48dcb516bc48_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaad0baf81e0f68f748129b8713909f%252Fpa%252FAS36340_ed709c6aba1cb98b65897c00bc077482.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_ed709c6aba1cb98b65897c00bc077482.jpg saved to cache
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8995443d-5e42-5081-8645-48dcb516bc48
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073845fa50>
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8995443d-5e42-5081-8645-48dcb516bc48/8995443d-5e42-5081-8645-48dcb516bc48_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaad0baf81e0f68f748129b8713909f%252Fpa%252FAS36340_705d0c02272d26a6bfef9c0f7f33d95a.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_705d0c02272d26a6bfef9c0f7f33d95a.jpg saved to cache
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8995443d-5e42-5081-8645-48dcb516bc48
2026-03-30 11:22:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8995443d-5e42-5081-8645-48dcb516bc48, skipping ID generation
2026-03-30 11:22:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8995443d-5e42-5081-8645-48dcb516bc48 with scrape type 1
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8995443d-5e42-5081-8645-48dcb516bc48 sending to next pipeline
2026-03-30 11:22:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8995443d-5e42-5081-8645-48dcb516bc48, identifier: AS36340
2026-03-30 11:22:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8995443d-5e42-5081-8645-48dcb516bc48 with identifier: AS36340
2026-03-30 11:22:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8995443d-5e42-5081-8645-48dcb516bc48 with identifier: AS36340
2026-03-30 11:22:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8995443d-5e42-5081-8645-48dcb516bc48 with identifier: AS36340 to the API
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_705d0c02272d26a6bfef9c0f7f33d95a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:12:31Z',
'fuel_type': 'diesel',
'id': '8995443d-5e42-5081-8645-48dcb516bc48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS36340',
'listing': 'auction',
'location': 'FR, Nice',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 171941,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8995443d-5e42-5081-8645-48dcb516bc48/8995443d-5e42-5081-8645-48dcb516bc48_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95152,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_82dd4fbebfcc8fe6cb4f13b52250ddbb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8995443d-5e42-5081-8645-48dcb516bc48/8995443d-5e42-5081-8645-48dcb516bc48_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_80a52e735525676f6cb790e286029a2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8995443d-5e42-5081-8645-48dcb516bc48/8995443d-5e42-5081-8645-48dcb516bc48_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90154,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_b4ba4ca10951281b096f520c5a1fc1d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8995443d-5e42-5081-8645-48dcb516bc48/8995443d-5e42-5081-8645-48dcb516bc48_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83229,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_5188c4271221582c07f09a7d2d2b0ffa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8995443d-5e42-5081-8645-48dcb516bc48/8995443d-5e42-5081-8645-48dcb516bc48_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_36b8ac74d5a032f6f7d72764038c375d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8995443d-5e42-5081-8645-48dcb516bc48/8995443d-5e42-5081-8645-48dcb516bc48_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90085,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_6d5675a850ab5e5ab6ad34d6a365caa9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8995443d-5e42-5081-8645-48dcb516bc48/8995443d-5e42-5081-8645-48dcb516bc48_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83888,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_1a80943e005b38bfab7b08b6158e2f63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8995443d-5e42-5081-8645-48dcb516bc48/8995443d-5e42-5081-8645-48dcb516bc48_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103316,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_1b2f30b25e2cff9dc31e754346e7a51c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8995443d-5e42-5081-8645-48dcb516bc48/8995443d-5e42-5081-8645-48dcb516bc48_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98489,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_ed709c6aba1cb98b65897c00bc077482.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8995443d-5e42-5081-8645-48dcb516bc48/8995443d-5e42-5081-8645-48dcb516bc48_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70111,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/aa/6eaad0baf81e0f68f748129b8713909f/pa/AS36340_705d0c02272d26a6bfef9c0f7f33d95a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-31',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Allstar BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Allstar BlueMotion Tech',
'year': 2016}
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS36340%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.fr] INFO: Saving data for AS36340: {'created_time': 1774869763.28887, 'last_price_update_time': 1774869763.28888, 'auction_closing_time': 1774969951.0}
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AS36340') HTTP/1.1" 204 0
2026-03-30 11:22:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GP12773> (referer: https://www.auto1.com/v1/car-details-view/GP12773/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a022ee15-a35d-5e25-9498-3e0c0f78a85e with identifier: GP12773
2026-03-30 11:22:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a022ee15-a35d-5e25-9498-3e0c0f78a85e with scrape type 1
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a022ee15-a35d-5e25-9498-3e0c0f78a85e
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fbd%252F38bd56fab7292dc68ae3227136f2cc5c%252Fpa%252FGP12773_5b9ab0322db7223d18bdff4668520d1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_5b9ab0322db7223d18bdff4668520d1e.jpg not downloaded yet
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fbd%252F38bd56fab7292dc68ae3227136f2cc5c%252Fpa%252FGP12773_c30d34d737b7ae9fa0ec8283edee7950.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_c30d34d737b7ae9fa0ec8283edee7950.jpg not downloaded yet
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fbd%252F38bd56fab7292dc68ae3227136f2cc5c%252Fpa%252FGP12773_203a4b5168604fdebbedac63aa4a44c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_203a4b5168604fdebbedac63aa4a44c9.jpg not downloaded yet
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fbd%252F38bd56fab7292dc68ae3227136f2cc5c%252Fpa%252FGP12773_1cbab1995106267fbf3ace5d6d138b15.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_1cbab1995106267fbf3ace5d6d138b15.jpg not downloaded yet
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fbd%252F38bd56fab7292dc68ae3227136f2cc5c%252Fpa%252FGP12773_0f1be0923f12c2d44986aa9313670875.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_0f1be0923f12c2d44986aa9313670875.jpg not downloaded yet
2026-03-30 11:22:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_c30d34d737b7ae9fa0ec8283edee7950.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_5b9ab0322db7223d18bdff4668520d1e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fbd%252F38bd56fab7292dc68ae3227136f2cc5c%252Fpa%252FGP12773_0d83ec343da8b08f8ee1b4dee450782d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_0d83ec343da8b08f8ee1b4dee450782d.jpg not downloaded yet
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fbd%252F38bd56fab7292dc68ae3227136f2cc5c%252Fpa%252FGP12773_70984dc67b13589c2b1b8bb68df72d46.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_70984dc67b13589c2b1b8bb68df72d46.jpg not downloaded yet
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fbd%252F38bd56fab7292dc68ae3227136f2cc5c%252Fpa%252FGP12773_0f5046982ea354cfbfa6340485ee891d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_0f5046982ea354cfbfa6340485ee891d.jpg not downloaded yet
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fbd%252F38bd56fab7292dc68ae3227136f2cc5c%252Fpa%252FGP12773_b2bf03ee018b4b840f2d0ae1f75452c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_b2bf03ee018b4b840f2d0ae1f75452c7.jpg not downloaded yet
2026-03-30 11:22:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_203a4b5168604fdebbedac63aa4a44c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fbd%252F38bd56fab7292dc68ae3227136f2cc5c%252Fpa%252FGP12773_8298f4d51390cf6c9488fbd2ef9e277e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_8298f4d51390cf6c9488fbd2ef9e277e.jpg not downloaded yet
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738545250>
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a022ee15-a35d-5e25-9498-3e0c0f78a85e/a022ee15-a35d-5e25-9498-3e0c0f78a85e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fbd%252F38bd56fab7292dc68ae3227136f2cc5c%252Fpa%252FGP12773_c30d34d737b7ae9fa0ec8283edee7950.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_c30d34d737b7ae9fa0ec8283edee7950.jpg saved to cache
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a022ee15-a35d-5e25-9498-3e0c0f78a85e
2026-03-30 11:22:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_70984dc67b13589c2b1b8bb68df72d46.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a7eb8d0>
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a022ee15-a35d-5e25-9498-3e0c0f78a85e/a022ee15-a35d-5e25-9498-3e0c0f78a85e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fbd%252F38bd56fab7292dc68ae3227136f2cc5c%252Fpa%252FGP12773_5b9ab0322db7223d18bdff4668520d1e.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_5b9ab0322db7223d18bdff4668520d1e.jpg saved to cache
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a022ee15-a35d-5e25-9498-3e0c0f78a85e
2026-03-30 11:22:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_1cbab1995106267fbf3ace5d6d138b15.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a49d650>
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a022ee15-a35d-5e25-9498-3e0c0f78a85e/a022ee15-a35d-5e25-9498-3e0c0f78a85e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fbd%252F38bd56fab7292dc68ae3227136f2cc5c%252Fpa%252FGP12773_203a4b5168604fdebbedac63aa4a44c9.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_203a4b5168604fdebbedac63aa4a44c9.jpg saved to cache
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a022ee15-a35d-5e25-9498-3e0c0f78a85e
2026-03-30 11:22:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_0f1be0923f12c2d44986aa9313670875.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_0d83ec343da8b08f8ee1b4dee450782d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384c79d0>
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a022ee15-a35d-5e25-9498-3e0c0f78a85e/a022ee15-a35d-5e25-9498-3e0c0f78a85e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fbd%252F38bd56fab7292dc68ae3227136f2cc5c%252Fpa%252FGP12773_70984dc67b13589c2b1b8bb68df72d46.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_70984dc67b13589c2b1b8bb68df72d46.jpg saved to cache
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a022ee15-a35d-5e25-9498-3e0c0f78a85e
2026-03-30 11:22:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_b2bf03ee018b4b840f2d0ae1f75452c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_8298f4d51390cf6c9488fbd2ef9e277e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_0f5046982ea354cfbfa6340485ee891d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a7e9dd0>
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a022ee15-a35d-5e25-9498-3e0c0f78a85e/a022ee15-a35d-5e25-9498-3e0c0f78a85e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fbd%252F38bd56fab7292dc68ae3227136f2cc5c%252Fpa%252FGP12773_1cbab1995106267fbf3ace5d6d138b15.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_1cbab1995106267fbf3ace5d6d138b15.jpg saved to cache
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a022ee15-a35d-5e25-9498-3e0c0f78a85e
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738560810>
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a022ee15-a35d-5e25-9498-3e0c0f78a85e/a022ee15-a35d-5e25-9498-3e0c0f78a85e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fbd%252F38bd56fab7292dc68ae3227136f2cc5c%252Fpa%252FGP12773_0f1be0923f12c2d44986aa9313670875.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_0f1be0923f12c2d44986aa9313670875.jpg saved to cache
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a022ee15-a35d-5e25-9498-3e0c0f78a85e
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385d7b50>
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a022ee15-a35d-5e25-9498-3e0c0f78a85e/a022ee15-a35d-5e25-9498-3e0c0f78a85e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fbd%252F38bd56fab7292dc68ae3227136f2cc5c%252Fpa%252FGP12773_0d83ec343da8b08f8ee1b4dee450782d.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_0d83ec343da8b08f8ee1b4dee450782d.jpg saved to cache
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a022ee15-a35d-5e25-9498-3e0c0f78a85e
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073859d9d0>
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a022ee15-a35d-5e25-9498-3e0c0f78a85e/a022ee15-a35d-5e25-9498-3e0c0f78a85e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fbd%252F38bd56fab7292dc68ae3227136f2cc5c%252Fpa%252FGP12773_b2bf03ee018b4b840f2d0ae1f75452c7.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_b2bf03ee018b4b840f2d0ae1f75452c7.jpg saved to cache
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a022ee15-a35d-5e25-9498-3e0c0f78a85e
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383d1450>
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a022ee15-a35d-5e25-9498-3e0c0f78a85e/a022ee15-a35d-5e25-9498-3e0c0f78a85e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fbd%252F38bd56fab7292dc68ae3227136f2cc5c%252Fpa%252FGP12773_8298f4d51390cf6c9488fbd2ef9e277e.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_8298f4d51390cf6c9488fbd2ef9e277e.jpg saved to cache
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a022ee15-a35d-5e25-9498-3e0c0f78a85e
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383aa690>
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a022ee15-a35d-5e25-9498-3e0c0f78a85e/a022ee15-a35d-5e25-9498-3e0c0f78a85e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fbd%252F38bd56fab7292dc68ae3227136f2cc5c%252Fpa%252FGP12773_0f5046982ea354cfbfa6340485ee891d.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_0f5046982ea354cfbfa6340485ee891d.jpg saved to cache
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a022ee15-a35d-5e25-9498-3e0c0f78a85e
2026-03-30 11:22:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a022ee15-a35d-5e25-9498-3e0c0f78a85e, skipping ID generation
2026-03-30 11:22:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a022ee15-a35d-5e25-9498-3e0c0f78a85e with scrape type 1
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a022ee15-a35d-5e25-9498-3e0c0f78a85e sending to next pipeline
2026-03-30 11:22:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a022ee15-a35d-5e25-9498-3e0c0f78a85e, identifier: GP12773
2026-03-30 11:22:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a022ee15-a35d-5e25-9498-3e0c0f78a85e with identifier: GP12773
2026-03-30 11:22:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a022ee15-a35d-5e25-9498-3e0c0f78a85e with identifier: GP12773
2026-03-30 11:22:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a022ee15-a35d-5e25-9498-3e0c0f78a85e with identifier: GP12773 to the API
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_0f5046982ea354cfbfa6340485ee891d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 101,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:02:34Z',
'fuel_type': 'diesel',
'id': 'a022ee15-a35d-5e25-9498-3e0c0f78a85e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP12773',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 124644,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a022ee15-a35d-5e25-9498-3e0c0f78a85e/a022ee15-a35d-5e25-9498-3e0c0f78a85e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_5b9ab0322db7223d18bdff4668520d1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a022ee15-a35d-5e25-9498-3e0c0f78a85e/a022ee15-a35d-5e25-9498-3e0c0f78a85e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_c30d34d737b7ae9fa0ec8283edee7950.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a022ee15-a35d-5e25-9498-3e0c0f78a85e/a022ee15-a35d-5e25-9498-3e0c0f78a85e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51630,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_203a4b5168604fdebbedac63aa4a44c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a022ee15-a35d-5e25-9498-3e0c0f78a85e/a022ee15-a35d-5e25-9498-3e0c0f78a85e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42460,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_1cbab1995106267fbf3ace5d6d138b15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a022ee15-a35d-5e25-9498-3e0c0f78a85e/a022ee15-a35d-5e25-9498-3e0c0f78a85e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44928,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_0f1be0923f12c2d44986aa9313670875.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a022ee15-a35d-5e25-9498-3e0c0f78a85e/a022ee15-a35d-5e25-9498-3e0c0f78a85e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47368,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_0d83ec343da8b08f8ee1b4dee450782d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a022ee15-a35d-5e25-9498-3e0c0f78a85e/a022ee15-a35d-5e25-9498-3e0c0f78a85e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49260,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_70984dc67b13589c2b1b8bb68df72d46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a022ee15-a35d-5e25-9498-3e0c0f78a85e/a022ee15-a35d-5e25-9498-3e0c0f78a85e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_0f5046982ea354cfbfa6340485ee891d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a022ee15-a35d-5e25-9498-3e0c0f78a85e/a022ee15-a35d-5e25-9498-3e0c0f78a85e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45005,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_b2bf03ee018b4b840f2d0ae1f75452c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a022ee15-a35d-5e25-9498-3e0c0f78a85e/a022ee15-a35d-5e25-9498-3e0c0f78a85e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67627,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/bd/38bd56fab7292dc68ae3227136f2cc5c/pa/GP12773_8298f4d51390cf6c9488fbd2ef9e277e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-08-24',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Sensation',
'transmission': 'automatic',
'trim': 'BlueEfficiency Sensation',
'year': 2016}
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP12773%27 HTTP/1.1" 200 None
2026-03-30 11:22:44 [auto1.fr] INFO: Saving data for GP12773: {'created_time': 1774869764.781289, 'last_price_update_time': 1774869764.781303, 'auction_closing_time': 1774969354.0}
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GP12773') HTTP/1.1" 204 0
2026-03-30 11:22:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU12813> (referer: https://www.auto1.com/v1/car-details-view/RU12813/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcdd6262-a440-5293-899f-9b9740843d03 with identifier: RU12813
2026-03-30 11:22:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcdd6262-a440-5293-899f-9b9740843d03 with scrape type 1
2026-03-30 11:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bcdd6262-a440-5293-899f-9b9740843d03
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc2%252F22c252912d5a434b9df25469651ddf4a%252Fpa%252FRU12813_0946346a7802a27eab7a74c54f52e65c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_0946346a7802a27eab7a74c54f52e65c.jpg not downloaded yet
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc2%252F22c252912d5a434b9df25469651ddf4a%252Fpa%252FRU12813_3fea0d1e21d3a22c7efc20bdad2f445d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_3fea0d1e21d3a22c7efc20bdad2f445d.jpg not downloaded yet
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc2%252F22c252912d5a434b9df25469651ddf4a%252Fpa%252FRU12813_cc366af9f87c37c2d12bfe05a680a9ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_cc366af9f87c37c2d12bfe05a680a9ba.jpg not downloaded yet
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc2%252F22c252912d5a434b9df25469651ddf4a%252Fpa%252FRU12813_f6d2f390a2788272f640e573edceb7e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_f6d2f390a2788272f640e573edceb7e2.jpg not downloaded yet
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc2%252F22c252912d5a434b9df25469651ddf4a%252Fpa%252FRU12813_c32a8c10e7282e40d6d190b5395f68ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_c32a8c10e7282e40d6d190b5395f68ae.jpg not downloaded yet
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc2%252F22c252912d5a434b9df25469651ddf4a%252Fpa%252FRU12813_cdce754dcaf7912d63cd22efa9a58625.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_cdce754dcaf7912d63cd22efa9a58625.jpg not downloaded yet
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc2%252F22c252912d5a434b9df25469651ddf4a%252Fpa%252FRU12813_e4d28c305ccfab2a8b068ef3b66d4bb3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_e4d28c305ccfab2a8b068ef3b66d4bb3.jpg not downloaded yet
2026-03-30 11:22:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_0946346a7802a27eab7a74c54f52e65c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_3fea0d1e21d3a22c7efc20bdad2f445d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc2%252F22c252912d5a434b9df25469651ddf4a%252Fpa%252FRU12813_1f2fce26bb3334be8ae175aa694a1cf1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_1f2fce26bb3334be8ae175aa694a1cf1.jpg not downloaded yet
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc2%252F22c252912d5a434b9df25469651ddf4a%252Fpa%252FRU12813_5e86fdadd018a88021bd57b668691a73.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_5e86fdadd018a88021bd57b668691a73.jpg not downloaded yet
2026-03-30 11:22:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_cc366af9f87c37c2d12bfe05a680a9ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc2%252F22c252912d5a434b9df25469651ddf4a%252Fpa%252FRU12813_1ec9216777efe4d209f92c14712001b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_1ec9216777efe4d209f92c14712001b2.jpg not downloaded yet
2026-03-30 11:22:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_e4d28c305ccfab2a8b068ef3b66d4bb3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383d2d90>
2026-03-30 11:22:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcdd6262-a440-5293-899f-9b9740843d03/bcdd6262-a440-5293-899f-9b9740843d03_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc2%252F22c252912d5a434b9df25469651ddf4a%252Fpa%252FRU12813_0946346a7802a27eab7a74c54f52e65c.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_0946346a7802a27eab7a74c54f52e65c.jpg saved to cache
2026-03-30 11:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bcdd6262-a440-5293-899f-9b9740843d03
2026-03-30 11:22:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738428990>
2026-03-30 11:22:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcdd6262-a440-5293-899f-9b9740843d03/bcdd6262-a440-5293-899f-9b9740843d03_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc2%252F22c252912d5a434b9df25469651ddf4a%252Fpa%252FRU12813_3fea0d1e21d3a22c7efc20bdad2f445d.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_3fea0d1e21d3a22c7efc20bdad2f445d.jpg saved to cache
2026-03-30 11:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bcdd6262-a440-5293-899f-9b9740843d03
2026-03-30 11:22:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_f6d2f390a2788272f640e573edceb7e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_cdce754dcaf7912d63cd22efa9a58625.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384a2290>
2026-03-30 11:22:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcdd6262-a440-5293-899f-9b9740843d03/bcdd6262-a440-5293-899f-9b9740843d03_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc2%252F22c252912d5a434b9df25469651ddf4a%252Fpa%252FRU12813_cc366af9f87c37c2d12bfe05a680a9ba.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_cc366af9f87c37c2d12bfe05a680a9ba.jpg saved to cache
2026-03-30 11:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bcdd6262-a440-5293-899f-9b9740843d03
2026-03-30 11:22:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383bc190>
2026-03-30 11:22:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcdd6262-a440-5293-899f-9b9740843d03/bcdd6262-a440-5293-899f-9b9740843d03_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc2%252F22c252912d5a434b9df25469651ddf4a%252Fpa%252FRU12813_e4d28c305ccfab2a8b068ef3b66d4bb3.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_e4d28c305ccfab2a8b068ef3b66d4bb3.jpg saved to cache
2026-03-30 11:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bcdd6262-a440-5293-899f-9b9740843d03
2026-03-30 11:22:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_c32a8c10e7282e40d6d190b5395f68ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_1f2fce26bb3334be8ae175aa694a1cf1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_1ec9216777efe4d209f92c14712001b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_5e86fdadd018a88021bd57b668691a73.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738774510>
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcdd6262-a440-5293-899f-9b9740843d03/bcdd6262-a440-5293-899f-9b9740843d03_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc2%252F22c252912d5a434b9df25469651ddf4a%252Fpa%252FRU12813_f6d2f390a2788272f640e573edceb7e2.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_f6d2f390a2788272f640e573edceb7e2.jpg saved to cache
2026-03-30 11:22:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bcdd6262-a440-5293-899f-9b9740843d03
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a7bd510>
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcdd6262-a440-5293-899f-9b9740843d03/bcdd6262-a440-5293-899f-9b9740843d03_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc2%252F22c252912d5a434b9df25469651ddf4a%252Fpa%252FRU12813_cdce754dcaf7912d63cd22efa9a58625.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_cdce754dcaf7912d63cd22efa9a58625.jpg saved to cache
2026-03-30 11:22:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bcdd6262-a440-5293-899f-9b9740843d03
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738732f50>
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcdd6262-a440-5293-899f-9b9740843d03/bcdd6262-a440-5293-899f-9b9740843d03_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc2%252F22c252912d5a434b9df25469651ddf4a%252Fpa%252FRU12813_c32a8c10e7282e40d6d190b5395f68ae.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_c32a8c10e7282e40d6d190b5395f68ae.jpg saved to cache
2026-03-30 11:22:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bcdd6262-a440-5293-899f-9b9740843d03
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073845fc90>
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcdd6262-a440-5293-899f-9b9740843d03/bcdd6262-a440-5293-899f-9b9740843d03_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc2%252F22c252912d5a434b9df25469651ddf4a%252Fpa%252FRU12813_1f2fce26bb3334be8ae175aa694a1cf1.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_1f2fce26bb3334be8ae175aa694a1cf1.jpg saved to cache
2026-03-30 11:22:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bcdd6262-a440-5293-899f-9b9740843d03
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384a7c50>
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcdd6262-a440-5293-899f-9b9740843d03/bcdd6262-a440-5293-899f-9b9740843d03_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc2%252F22c252912d5a434b9df25469651ddf4a%252Fpa%252FRU12813_1ec9216777efe4d209f92c14712001b2.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_1ec9216777efe4d209f92c14712001b2.jpg saved to cache
2026-03-30 11:22:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bcdd6262-a440-5293-899f-9b9740843d03
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383fd310>
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcdd6262-a440-5293-899f-9b9740843d03/bcdd6262-a440-5293-899f-9b9740843d03_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc2%252F22c252912d5a434b9df25469651ddf4a%252Fpa%252FRU12813_5e86fdadd018a88021bd57b668691a73.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_5e86fdadd018a88021bd57b668691a73.jpg saved to cache
2026-03-30 11:22:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bcdd6262-a440-5293-899f-9b9740843d03
2026-03-30 11:22:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bcdd6262-a440-5293-899f-9b9740843d03, skipping ID generation
2026-03-30 11:22:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcdd6262-a440-5293-899f-9b9740843d03 with scrape type 1
2026-03-30 11:22:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bcdd6262-a440-5293-899f-9b9740843d03 sending to next pipeline
2026-03-30 11:22:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bcdd6262-a440-5293-899f-9b9740843d03, identifier: RU12813
2026-03-30 11:22:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bcdd6262-a440-5293-899f-9b9740843d03 with identifier: RU12813
2026-03-30 11:22:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bcdd6262-a440-5293-899f-9b9740843d03 with identifier: RU12813
2026-03-30 11:22:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bcdd6262-a440-5293-899f-9b9740843d03 with identifier: RU12813 to the API
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_5e86fdadd018a88021bd57b668691a73.jpg>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:24:48Z',
'fuel_type': 'petrol',
'id': 'bcdd6262-a440-5293-899f-9b9740843d03',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU12813',
'listing': 'auction',
'location': 'FR',
'make': 'Peugeot',
'model': '208',
'odometer': 136913,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcdd6262-a440-5293-899f-9b9740843d03/bcdd6262-a440-5293-899f-9b9740843d03_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97779,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_0946346a7802a27eab7a74c54f52e65c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcdd6262-a440-5293-899f-9b9740843d03/bcdd6262-a440-5293-899f-9b9740843d03_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102362,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_3fea0d1e21d3a22c7efc20bdad2f445d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcdd6262-a440-5293-899f-9b9740843d03/bcdd6262-a440-5293-899f-9b9740843d03_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86535,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_cc366af9f87c37c2d12bfe05a680a9ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcdd6262-a440-5293-899f-9b9740843d03/bcdd6262-a440-5293-899f-9b9740843d03_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79747,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_f6d2f390a2788272f640e573edceb7e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcdd6262-a440-5293-899f-9b9740843d03/bcdd6262-a440-5293-899f-9b9740843d03_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85340,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_c32a8c10e7282e40d6d190b5395f68ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcdd6262-a440-5293-899f-9b9740843d03/bcdd6262-a440-5293-899f-9b9740843d03_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87413,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_cdce754dcaf7912d63cd22efa9a58625.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcdd6262-a440-5293-899f-9b9740843d03/bcdd6262-a440-5293-899f-9b9740843d03_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89870,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_e4d28c305ccfab2a8b068ef3b66d4bb3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcdd6262-a440-5293-899f-9b9740843d03/bcdd6262-a440-5293-899f-9b9740843d03_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91675,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_1f2fce26bb3334be8ae175aa694a1cf1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcdd6262-a440-5293-899f-9b9740843d03/bcdd6262-a440-5293-899f-9b9740843d03_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71893,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_5e86fdadd018a88021bd57b668691a73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcdd6262-a440-5293-899f-9b9740843d03/bcdd6262-a440-5293-899f-9b9740843d03_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/c2/22c252912d5a434b9df25469651ddf4a/pa/RU12813_1ec9216777efe4d209f92c14712001b2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-05-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.0 VTi Like',
'transmission': 'manual',
'trim': 'Like',
'year': 2016}
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU12813%27 HTTP/1.1" 200 None
2026-03-30 11:22:49 [auto1.fr] INFO: Saving data for RU12813: {'created_time': 1774869769.808716, 'last_price_update_time': 1774869769.808733, 'auction_closing_time': 1774970688.0}
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RU12813') HTTP/1.1" 204 0
2026-03-30 11:22:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PW51275> (referer: https://www.auto1.com/v1/car-details-view/PW51275/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec660d06-5cd3-5eb6-803d-17e49a5d8f01 with identifier: PW51275
2026-03-30 11:22:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec660d06-5cd3-5eb6-803d-17e49a5d8f01 with scrape type 1
2026-03-30 11:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec660d06-5cd3-5eb6-803d-17e49a5d8f01
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b810687e2c40e6f782acdbf3d03acd%252Fpa%252FPW51275_1b205f33cd069aece51c54f161624674.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_1b205f33cd069aece51c54f161624674.jpg not downloaded yet
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b810687e2c40e6f782acdbf3d03acd%252Fpa%252FPW51275_60a76e5b62882fccf0606edc4141594b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_60a76e5b62882fccf0606edc4141594b.jpg not downloaded yet
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b810687e2c40e6f782acdbf3d03acd%252Fpa%252FPW51275_1db5e5908e301d92d9cc93f92d5ece86.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_1db5e5908e301d92d9cc93f92d5ece86.jpg not downloaded yet
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b810687e2c40e6f782acdbf3d03acd%252Fpa%252FPW51275_1c8e7d1c694205ed64d79e31f0557fbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_1c8e7d1c694205ed64d79e31f0557fbd.jpg not downloaded yet
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b810687e2c40e6f782acdbf3d03acd%252Fpa%252FPW51275_49fa00f63a3618f05fce694b07fc1d70.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_49fa00f63a3618f05fce694b07fc1d70.jpg not downloaded yet
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b810687e2c40e6f782acdbf3d03acd%252Fpa%252FPW51275_c61b4abdf5ff9a3bb6a76bf643fbfcaf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_c61b4abdf5ff9a3bb6a76bf643fbfcaf.jpg not downloaded yet
2026-03-30 11:22:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_1b205f33cd069aece51c54f161624674.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_60a76e5b62882fccf0606edc4141594b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b810687e2c40e6f782acdbf3d03acd%252Fpa%252FPW51275_8c8933d5e138a901ff8872f8d77da1ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_8c8933d5e138a901ff8872f8d77da1ee.jpg not downloaded yet
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b810687e2c40e6f782acdbf3d03acd%252Fpa%252FPW51275_994bb800929801f1d45f72a90ef962e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_994bb800929801f1d45f72a90ef962e7.jpg not downloaded yet
2026-03-30 11:22:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_1db5e5908e301d92d9cc93f92d5ece86.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b810687e2c40e6f782acdbf3d03acd%252Fpa%252FPW51275_41c8d2e35938f18728563f03c59d6f67.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_41c8d2e35938f18728563f03c59d6f67.jpg not downloaded yet
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b810687e2c40e6f782acdbf3d03acd%252Fpa%252FPW51275_c3602a6e62381ebb4989bbd72b5b654e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_c3602a6e62381ebb4989bbd72b5b654e.jpg not downloaded yet
2026-03-30 11:22:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_1c8e7d1c694205ed64d79e31f0557fbd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a7ec0d0>
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec660d06-5cd3-5eb6-803d-17e49a5d8f01/ec660d06-5cd3-5eb6-803d-17e49a5d8f01_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b810687e2c40e6f782acdbf3d03acd%252Fpa%252FPW51275_1b205f33cd069aece51c54f161624674.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_1b205f33cd069aece51c54f161624674.jpg saved to cache
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec660d06-5cd3-5eb6-803d-17e49a5d8f01
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a4f05d0>
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec660d06-5cd3-5eb6-803d-17e49a5d8f01/ec660d06-5cd3-5eb6-803d-17e49a5d8f01_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b810687e2c40e6f782acdbf3d03acd%252Fpa%252FPW51275_60a76e5b62882fccf0606edc4141594b.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_60a76e5b62882fccf0606edc4141594b.jpg saved to cache
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec660d06-5cd3-5eb6-803d-17e49a5d8f01
2026-03-30 11:22:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_8c8933d5e138a901ff8872f8d77da1ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_c61b4abdf5ff9a3bb6a76bf643fbfcaf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738707f90>
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec660d06-5cd3-5eb6-803d-17e49a5d8f01/ec660d06-5cd3-5eb6-803d-17e49a5d8f01_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b810687e2c40e6f782acdbf3d03acd%252Fpa%252FPW51275_1db5e5908e301d92d9cc93f92d5ece86.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_1db5e5908e301d92d9cc93f92d5ece86.jpg saved to cache
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec660d06-5cd3-5eb6-803d-17e49a5d8f01
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384e4fd0>
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec660d06-5cd3-5eb6-803d-17e49a5d8f01/ec660d06-5cd3-5eb6-803d-17e49a5d8f01_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b810687e2c40e6f782acdbf3d03acd%252Fpa%252FPW51275_1c8e7d1c694205ed64d79e31f0557fbd.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_1c8e7d1c694205ed64d79e31f0557fbd.jpg saved to cache
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec660d06-5cd3-5eb6-803d-17e49a5d8f01
2026-03-30 11:22:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_49fa00f63a3618f05fce694b07fc1d70.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_994bb800929801f1d45f72a90ef962e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383d08d0>
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec660d06-5cd3-5eb6-803d-17e49a5d8f01/ec660d06-5cd3-5eb6-803d-17e49a5d8f01_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b810687e2c40e6f782acdbf3d03acd%252Fpa%252FPW51275_8c8933d5e138a901ff8872f8d77da1ee.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_8c8933d5e138a901ff8872f8d77da1ee.jpg saved to cache
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ec660d06-5cd3-5eb6-803d-17e49a5d8f01
2026-03-30 11:22:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_41c8d2e35938f18728563f03c59d6f67.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738595290>
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec660d06-5cd3-5eb6-803d-17e49a5d8f01/ec660d06-5cd3-5eb6-803d-17e49a5d8f01_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b810687e2c40e6f782acdbf3d03acd%252Fpa%252FPW51275_c61b4abdf5ff9a3bb6a76bf643fbfcaf.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_c61b4abdf5ff9a3bb6a76bf643fbfcaf.jpg saved to cache
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec660d06-5cd3-5eb6-803d-17e49a5d8f01
2026-03-30 11:22:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_c3602a6e62381ebb4989bbd72b5b654e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385854d0>
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec660d06-5cd3-5eb6-803d-17e49a5d8f01/ec660d06-5cd3-5eb6-803d-17e49a5d8f01_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b810687e2c40e6f782acdbf3d03acd%252Fpa%252FPW51275_49fa00f63a3618f05fce694b07fc1d70.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_49fa00f63a3618f05fce694b07fc1d70.jpg saved to cache
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec660d06-5cd3-5eb6-803d-17e49a5d8f01
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384e7090>
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec660d06-5cd3-5eb6-803d-17e49a5d8f01/ec660d06-5cd3-5eb6-803d-17e49a5d8f01_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b810687e2c40e6f782acdbf3d03acd%252Fpa%252FPW51275_994bb800929801f1d45f72a90ef962e7.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_994bb800929801f1d45f72a90ef962e7.jpg saved to cache
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ec660d06-5cd3-5eb6-803d-17e49a5d8f01
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0746c9d750>
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec660d06-5cd3-5eb6-803d-17e49a5d8f01/ec660d06-5cd3-5eb6-803d-17e49a5d8f01_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b810687e2c40e6f782acdbf3d03acd%252Fpa%252FPW51275_41c8d2e35938f18728563f03c59d6f67.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_41c8d2e35938f18728563f03c59d6f67.jpg saved to cache
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ec660d06-5cd3-5eb6-803d-17e49a5d8f01
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738716010>
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec660d06-5cd3-5eb6-803d-17e49a5d8f01/ec660d06-5cd3-5eb6-803d-17e49a5d8f01_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b810687e2c40e6f782acdbf3d03acd%252Fpa%252FPW51275_c3602a6e62381ebb4989bbd72b5b654e.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_c3602a6e62381ebb4989bbd72b5b654e.jpg saved to cache
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ec660d06-5cd3-5eb6-803d-17e49a5d8f01
2026-03-30 11:22:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec660d06-5cd3-5eb6-803d-17e49a5d8f01, skipping ID generation
2026-03-30 11:22:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec660d06-5cd3-5eb6-803d-17e49a5d8f01 with scrape type 1
2026-03-30 11:22:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec660d06-5cd3-5eb6-803d-17e49a5d8f01 sending to next pipeline
2026-03-30 11:22:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ec660d06-5cd3-5eb6-803d-17e49a5d8f01, identifier: PW51275
2026-03-30 11:22:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ec660d06-5cd3-5eb6-803d-17e49a5d8f01 with identifier: PW51275
2026-03-30 11:22:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ec660d06-5cd3-5eb6-803d-17e49a5d8f01 with identifier: PW51275
2026-03-30 11:22:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ec660d06-5cd3-5eb6-803d-17e49a5d8f01 with identifier: PW51275 to the API
2026-03-30 11:22:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_c3602a6e62381ebb4989bbd72b5b654e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 3',
'engine': '1.4L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:54:50Z',
'fuel_type': 'diesel',
'id': 'ec660d06-5cd3-5eb6-803d-17e49a5d8f01',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW51275',
'listing': 'auction',
'location': 'FR',
'make': 'Citroen',
'model': 'C3',
'odometer': 234226,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec660d06-5cd3-5eb6-803d-17e49a5d8f01/ec660d06-5cd3-5eb6-803d-17e49a5d8f01_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147556,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_1b205f33cd069aece51c54f161624674.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec660d06-5cd3-5eb6-803d-17e49a5d8f01/ec660d06-5cd3-5eb6-803d-17e49a5d8f01_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145816,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_60a76e5b62882fccf0606edc4141594b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec660d06-5cd3-5eb6-803d-17e49a5d8f01/ec660d06-5cd3-5eb6-803d-17e49a5d8f01_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58080,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_1db5e5908e301d92d9cc93f92d5ece86.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec660d06-5cd3-5eb6-803d-17e49a5d8f01/ec660d06-5cd3-5eb6-803d-17e49a5d8f01_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49164,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_1c8e7d1c694205ed64d79e31f0557fbd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec660d06-5cd3-5eb6-803d-17e49a5d8f01/ec660d06-5cd3-5eb6-803d-17e49a5d8f01_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57950,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_49fa00f63a3618f05fce694b07fc1d70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec660d06-5cd3-5eb6-803d-17e49a5d8f01/ec660d06-5cd3-5eb6-803d-17e49a5d8f01_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61957,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_c61b4abdf5ff9a3bb6a76bf643fbfcaf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec660d06-5cd3-5eb6-803d-17e49a5d8f01/ec660d06-5cd3-5eb6-803d-17e49a5d8f01_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58187,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_8c8933d5e138a901ff8872f8d77da1ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec660d06-5cd3-5eb6-803d-17e49a5d8f01/ec660d06-5cd3-5eb6-803d-17e49a5d8f01_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107946,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_994bb800929801f1d45f72a90ef962e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec660d06-5cd3-5eb6-803d-17e49a5d8f01/ec660d06-5cd3-5eb6-803d-17e49a5d8f01_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74020,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_41c8d2e35938f18728563f03c59d6f67.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec660d06-5cd3-5eb6-803d-17e49a5d8f01/ec660d06-5cd3-5eb6-803d-17e49a5d8f01_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/b8/a7b810687e2c40e6f782acdbf3d03acd/pa/PW51275_c3602a6e62381ebb4989bbd72b5b654e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2003-04-10',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.4 HDi',
'transmission': 'manual',
'trim': '',
'year': 2003}
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PW51275%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [auto1.fr] INFO: Saving data for PW51275: {'created_time': 1774869773.135998, 'last_price_update_time': 1774869773.136014, 'auction_closing_time': 1774972490.0}
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PW51275') HTTP/1.1" 204 0
2026-03-30 11:22:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MV42636> (referer: https://www.auto1.com/v1/car-details-view/MV42636/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e7c9781-3d5c-5a95-b40f-4f2dfd485c79 with identifier: MV42636
2026-03-30 11:22:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e7c9781-3d5c-5a95-b40f-4f2dfd485c79 with scrape type 1
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4e7c9781-3d5c-5a95-b40f-4f2dfd485c79
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F92%252F40929c01519ce49ebb0fae947f5879e6%252Fpa%252FMV42636_41aa69befeab81b362621e7353806f0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_41aa69befeab81b362621e7353806f0b.jpg not downloaded yet
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F92%252F40929c01519ce49ebb0fae947f5879e6%252Fpa%252FMV42636_dd9eace95f16e14d942781d1ed63a8ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_dd9eace95f16e14d942781d1ed63a8ab.jpg not downloaded yet
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F92%252F40929c01519ce49ebb0fae947f5879e6%252Fpa%252FMV42636_c8be11c0144f048fa7cdde14ac822183.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_c8be11c0144f048fa7cdde14ac822183.jpg not downloaded yet
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F92%252F40929c01519ce49ebb0fae947f5879e6%252Fpa%252FMV42636_d3f2e070ca4a87fb8468e492279a0d48.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_d3f2e070ca4a87fb8468e492279a0d48.jpg not downloaded yet
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F92%252F40929c01519ce49ebb0fae947f5879e6%252Fpa%252FMV42636_c941de56fd99d479fd2c7d9a278e57b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_c941de56fd99d479fd2c7d9a278e57b8.jpg not downloaded yet
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F92%252F40929c01519ce49ebb0fae947f5879e6%252Fpa%252FMV42636_371b62e8102f4d091ab39de2624098d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_371b62e8102f4d091ab39de2624098d9.jpg not downloaded yet
2026-03-30 11:22:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_dd9eace95f16e14d942781d1ed63a8ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_41aa69befeab81b362621e7353806f0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F92%252F40929c01519ce49ebb0fae947f5879e6%252Fpa%252FMV42636_fca1805deb8163d041f9b172927aa80b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_fca1805deb8163d041f9b172927aa80b.jpg not downloaded yet
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F92%252F40929c01519ce49ebb0fae947f5879e6%252Fpa%252FMV42636_7b5681818282027638a32081a14c6dd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_7b5681818282027638a32081a14c6dd8.jpg not downloaded yet
2026-03-30 11:22:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_d3f2e070ca4a87fb8468e492279a0d48.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F92%252F40929c01519ce49ebb0fae947f5879e6%252Fpa%252FMV42636_8005ed471bb4693912982a5d4b8004ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_8005ed471bb4693912982a5d4b8004ee.jpg not downloaded yet
2026-03-30 11:22:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_c8be11c0144f048fa7cdde14ac822183.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F92%252F40929c01519ce49ebb0fae947f5879e6%252Fpa%252FMV42636_a8e8afce7cf73fedcc477ee9e5747122.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_a8e8afce7cf73fedcc477ee9e5747122.jpg not downloaded yet
2026-03-30 11:22:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_c941de56fd99d479fd2c7d9a278e57b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_371b62e8102f4d091ab39de2624098d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383db910>
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e7c9781-3d5c-5a95-b40f-4f2dfd485c79/4e7c9781-3d5c-5a95-b40f-4f2dfd485c79_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F92%252F40929c01519ce49ebb0fae947f5879e6%252Fpa%252FMV42636_dd9eace95f16e14d942781d1ed63a8ab.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_dd9eace95f16e14d942781d1ed63a8ab.jpg saved to cache
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4e7c9781-3d5c-5a95-b40f-4f2dfd485c79
2026-03-30 11:22:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_fca1805deb8163d041f9b172927aa80b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_7b5681818282027638a32081a14c6dd8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_8005ed471bb4693912982a5d4b8004ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_a8e8afce7cf73fedcc477ee9e5747122.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a7ebf90>
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e7c9781-3d5c-5a95-b40f-4f2dfd485c79/4e7c9781-3d5c-5a95-b40f-4f2dfd485c79_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F92%252F40929c01519ce49ebb0fae947f5879e6%252Fpa%252FMV42636_41aa69befeab81b362621e7353806f0b.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_41aa69befeab81b362621e7353806f0b.jpg saved to cache
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e7c9781-3d5c-5a95-b40f-4f2dfd485c79
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384b3390>
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e7c9781-3d5c-5a95-b40f-4f2dfd485c79/4e7c9781-3d5c-5a95-b40f-4f2dfd485c79_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F92%252F40929c01519ce49ebb0fae947f5879e6%252Fpa%252FMV42636_d3f2e070ca4a87fb8468e492279a0d48.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_d3f2e070ca4a87fb8468e492279a0d48.jpg saved to cache
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4e7c9781-3d5c-5a95-b40f-4f2dfd485c79
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385ea910>
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e7c9781-3d5c-5a95-b40f-4f2dfd485c79/4e7c9781-3d5c-5a95-b40f-4f2dfd485c79_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F92%252F40929c01519ce49ebb0fae947f5879e6%252Fpa%252FMV42636_c8be11c0144f048fa7cdde14ac822183.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_c8be11c0144f048fa7cdde14ac822183.jpg saved to cache
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4e7c9781-3d5c-5a95-b40f-4f2dfd485c79
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738427c50>
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e7c9781-3d5c-5a95-b40f-4f2dfd485c79/4e7c9781-3d5c-5a95-b40f-4f2dfd485c79_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F92%252F40929c01519ce49ebb0fae947f5879e6%252Fpa%252FMV42636_c941de56fd99d479fd2c7d9a278e57b8.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_c941de56fd99d479fd2c7d9a278e57b8.jpg saved to cache
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4e7c9781-3d5c-5a95-b40f-4f2dfd485c79
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073859f990>
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e7c9781-3d5c-5a95-b40f-4f2dfd485c79/4e7c9781-3d5c-5a95-b40f-4f2dfd485c79_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F92%252F40929c01519ce49ebb0fae947f5879e6%252Fpa%252FMV42636_371b62e8102f4d091ab39de2624098d9.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_371b62e8102f4d091ab39de2624098d9.jpg saved to cache
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4e7c9781-3d5c-5a95-b40f-4f2dfd485c79
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385be310>
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e7c9781-3d5c-5a95-b40f-4f2dfd485c79/4e7c9781-3d5c-5a95-b40f-4f2dfd485c79_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F92%252F40929c01519ce49ebb0fae947f5879e6%252Fpa%252FMV42636_fca1805deb8163d041f9b172927aa80b.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_fca1805deb8163d041f9b172927aa80b.jpg saved to cache
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4e7c9781-3d5c-5a95-b40f-4f2dfd485c79
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384296d0>
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e7c9781-3d5c-5a95-b40f-4f2dfd485c79/4e7c9781-3d5c-5a95-b40f-4f2dfd485c79_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F92%252F40929c01519ce49ebb0fae947f5879e6%252Fpa%252FMV42636_7b5681818282027638a32081a14c6dd8.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_7b5681818282027638a32081a14c6dd8.jpg saved to cache
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4e7c9781-3d5c-5a95-b40f-4f2dfd485c79
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384bb6d0>
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e7c9781-3d5c-5a95-b40f-4f2dfd485c79/4e7c9781-3d5c-5a95-b40f-4f2dfd485c79_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F92%252F40929c01519ce49ebb0fae947f5879e6%252Fpa%252FMV42636_8005ed471bb4693912982a5d4b8004ee.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_8005ed471bb4693912982a5d4b8004ee.jpg saved to cache
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4e7c9781-3d5c-5a95-b40f-4f2dfd485c79
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738584e10>
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e7c9781-3d5c-5a95-b40f-4f2dfd485c79/4e7c9781-3d5c-5a95-b40f-4f2dfd485c79_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F92%252F40929c01519ce49ebb0fae947f5879e6%252Fpa%252FMV42636_a8e8afce7cf73fedcc477ee9e5747122.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_a8e8afce7cf73fedcc477ee9e5747122.jpg saved to cache
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4e7c9781-3d5c-5a95-b40f-4f2dfd485c79
2026-03-30 11:22:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e7c9781-3d5c-5a95-b40f-4f2dfd485c79, skipping ID generation
2026-03-30 11:22:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e7c9781-3d5c-5a95-b40f-4f2dfd485c79 with scrape type 1
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e7c9781-3d5c-5a95-b40f-4f2dfd485c79 sending to next pipeline
2026-03-30 11:22:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4e7c9781-3d5c-5a95-b40f-4f2dfd485c79, identifier: MV42636
2026-03-30 11:22:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4e7c9781-3d5c-5a95-b40f-4f2dfd485c79 with identifier: MV42636
2026-03-30 11:22:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4e7c9781-3d5c-5a95-b40f-4f2dfd485c79 with identifier: MV42636
2026-03-30 11:22:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4e7c9781-3d5c-5a95-b40f-4f2dfd485c79 with identifier: MV42636 to the API
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_a8e8afce7cf73fedcc477ee9e5747122.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 92,
'expiration_date': '2026-03-31T15:52:39Z',
'fuel_type': 'diesel',
'id': '4e7c9781-3d5c-5a95-b40f-4f2dfd485c79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV42636',
'listing': 'auction',
'location': 'FR',
'make': 'Peugeot',
'model': '207',
'odometer': 220756,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e7c9781-3d5c-5a95-b40f-4f2dfd485c79/4e7c9781-3d5c-5a95-b40f-4f2dfd485c79_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41601,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_41aa69befeab81b362621e7353806f0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e7c9781-3d5c-5a95-b40f-4f2dfd485c79/4e7c9781-3d5c-5a95-b40f-4f2dfd485c79_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41245,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_dd9eace95f16e14d942781d1ed63a8ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e7c9781-3d5c-5a95-b40f-4f2dfd485c79/4e7c9781-3d5c-5a95-b40f-4f2dfd485c79_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42411,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_c8be11c0144f048fa7cdde14ac822183.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e7c9781-3d5c-5a95-b40f-4f2dfd485c79/4e7c9781-3d5c-5a95-b40f-4f2dfd485c79_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_d3f2e070ca4a87fb8468e492279a0d48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e7c9781-3d5c-5a95-b40f-4f2dfd485c79/4e7c9781-3d5c-5a95-b40f-4f2dfd485c79_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51228,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_c941de56fd99d479fd2c7d9a278e57b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e7c9781-3d5c-5a95-b40f-4f2dfd485c79/4e7c9781-3d5c-5a95-b40f-4f2dfd485c79_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_371b62e8102f4d091ab39de2624098d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e7c9781-3d5c-5a95-b40f-4f2dfd485c79/4e7c9781-3d5c-5a95-b40f-4f2dfd485c79_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33203,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_fca1805deb8163d041f9b172927aa80b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e7c9781-3d5c-5a95-b40f-4f2dfd485c79/4e7c9781-3d5c-5a95-b40f-4f2dfd485c79_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107701,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_7b5681818282027638a32081a14c6dd8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e7c9781-3d5c-5a95-b40f-4f2dfd485c79/4e7c9781-3d5c-5a95-b40f-4f2dfd485c79_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86392,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_8005ed471bb4693912982a5d4b8004ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e7c9781-3d5c-5a95-b40f-4f2dfd485c79/4e7c9781-3d5c-5a95-b40f-4f2dfd485c79_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65750,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/92/40929c01519ce49ebb0fae947f5879e6/pa/MV42636_a8e8afce7cf73fedcc477ee9e5747122.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-03-21',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 207 1.6 HDi Sportium',
'transmission': 'manual',
'trim': 'Sportium',
'year': 2012}
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV42636%27 HTTP/1.1" 200 None
2026-03-30 11:22:54 [auto1.fr] INFO: Saving data for MV42636: {'created_time': 1774869774.810168, 'last_price_update_time': 1774869774.810181, 'auction_closing_time': 1774972359.0}
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MV42636') HTTP/1.1" 204 0
2026-03-30 11:22:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CX62524> (referer: https://www.auto1.com/v1/car-details-view/CX62524/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cd04ba7-cccd-5fc2-8dda-b5df9576844f with identifier: CX62524
2026-03-30 11:22:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cd04ba7-cccd-5fc2-8dda-b5df9576844f with scrape type 1
2026-03-30 11:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4cd04ba7-cccd-5fc2-8dda-b5df9576844f
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F3d%252F923d620a2e2e96b72412ab040e4f12a7%252Fpa%252FCX62524_fb12fce5e8cbd2c5b8a2d7cfa0158581.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_fb12fce5e8cbd2c5b8a2d7cfa0158581.jpg not downloaded yet
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F3d%252F923d620a2e2e96b72412ab040e4f12a7%252Fpa%252FCX62524_5104f56954c3c3109c2aa98e7d0a0620.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_5104f56954c3c3109c2aa98e7d0a0620.jpg not downloaded yet
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F3d%252F923d620a2e2e96b72412ab040e4f12a7%252Fpa%252FCX62524_6c10391a51963510d527328d998a51b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_6c10391a51963510d527328d998a51b4.jpg not downloaded yet
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F3d%252F923d620a2e2e96b72412ab040e4f12a7%252Fpa%252FCX62524_776eeb974a05c5cd0d6b5dab02201bf0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_776eeb974a05c5cd0d6b5dab02201bf0.jpg not downloaded yet
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F3d%252F923d620a2e2e96b72412ab040e4f12a7%252Fpa%252FCX62524_edc372c887e0123936b0b33bdf658367.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_edc372c887e0123936b0b33bdf658367.jpg not downloaded yet
2026-03-30 11:22:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_5104f56954c3c3109c2aa98e7d0a0620.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_fb12fce5e8cbd2c5b8a2d7cfa0158581.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F3d%252F923d620a2e2e96b72412ab040e4f12a7%252Fpa%252FCX62524_3ededac63fd4a3105a4fd07aabf456fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_3ededac63fd4a3105a4fd07aabf456fe.jpg not downloaded yet
2026-03-30 11:22:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_6c10391a51963510d527328d998a51b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_776eeb974a05c5cd0d6b5dab02201bf0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F3d%252F923d620a2e2e96b72412ab040e4f12a7%252Fpa%252FCX62524_ee01eedee703caad025f0b4dc459188e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_ee01eedee703caad025f0b4dc459188e.jpg not downloaded yet
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F3d%252F923d620a2e2e96b72412ab040e4f12a7%252Fpa%252FCX62524_0bc988fde59cc72920c497d1edeebf2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_0bc988fde59cc72920c497d1edeebf2c.jpg not downloaded yet
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073859d0d0>
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cd04ba7-cccd-5fc2-8dda-b5df9576844f/4cd04ba7-cccd-5fc2-8dda-b5df9576844f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F3d%252F923d620a2e2e96b72412ab040e4f12a7%252Fpa%252FCX62524_5104f56954c3c3109c2aa98e7d0a0620.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_5104f56954c3c3109c2aa98e7d0a0620.jpg saved to cache
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4cd04ba7-cccd-5fc2-8dda-b5df9576844f
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a7f9e10>
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cd04ba7-cccd-5fc2-8dda-b5df9576844f/4cd04ba7-cccd-5fc2-8dda-b5df9576844f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F3d%252F923d620a2e2e96b72412ab040e4f12a7%252Fpa%252FCX62524_fb12fce5e8cbd2c5b8a2d7cfa0158581.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_fb12fce5e8cbd2c5b8a2d7cfa0158581.jpg saved to cache
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4cd04ba7-cccd-5fc2-8dda-b5df9576844f
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F3d%252F923d620a2e2e96b72412ab040e4f12a7%252Fpa%252FCX62524_0befe2d0a6d392d0bd5950d4c65542a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_0befe2d0a6d392d0bd5950d4c65542a8.jpg not downloaded yet
2026-03-30 11:22:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_edc372c887e0123936b0b33bdf658367.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_3ededac63fd4a3105a4fd07aabf456fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F3d%252F923d620a2e2e96b72412ab040e4f12a7%252Fpa%252FCX62524_96e1d807426e0de10f4bdc875122036b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_96e1d807426e0de10f4bdc875122036b.jpg not downloaded yet
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385aae90>
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cd04ba7-cccd-5fc2-8dda-b5df9576844f/4cd04ba7-cccd-5fc2-8dda-b5df9576844f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F3d%252F923d620a2e2e96b72412ab040e4f12a7%252Fpa%252FCX62524_6c10391a51963510d527328d998a51b4.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_6c10391a51963510d527328d998a51b4.jpg saved to cache
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4cd04ba7-cccd-5fc2-8dda-b5df9576844f
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384e8950>
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cd04ba7-cccd-5fc2-8dda-b5df9576844f/4cd04ba7-cccd-5fc2-8dda-b5df9576844f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F3d%252F923d620a2e2e96b72412ab040e4f12a7%252Fpa%252FCX62524_776eeb974a05c5cd0d6b5dab02201bf0.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_776eeb974a05c5cd0d6b5dab02201bf0.jpg saved to cache
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4cd04ba7-cccd-5fc2-8dda-b5df9576844f
2026-03-30 11:22:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_ee01eedee703caad025f0b4dc459188e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_0bc988fde59cc72920c497d1edeebf2c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384c9d50>
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cd04ba7-cccd-5fc2-8dda-b5df9576844f/4cd04ba7-cccd-5fc2-8dda-b5df9576844f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F3d%252F923d620a2e2e96b72412ab040e4f12a7%252Fpa%252FCX62524_edc372c887e0123936b0b33bdf658367.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_edc372c887e0123936b0b33bdf658367.jpg saved to cache
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4cd04ba7-cccd-5fc2-8dda-b5df9576844f
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385fcf50>
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cd04ba7-cccd-5fc2-8dda-b5df9576844f/4cd04ba7-cccd-5fc2-8dda-b5df9576844f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F3d%252F923d620a2e2e96b72412ab040e4f12a7%252Fpa%252FCX62524_3ededac63fd4a3105a4fd07aabf456fe.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_3ededac63fd4a3105a4fd07aabf456fe.jpg saved to cache
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4cd04ba7-cccd-5fc2-8dda-b5df9576844f
2026-03-30 11:22:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_0befe2d0a6d392d0bd5950d4c65542a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_96e1d807426e0de10f4bdc875122036b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385feed0>
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cd04ba7-cccd-5fc2-8dda-b5df9576844f/4cd04ba7-cccd-5fc2-8dda-b5df9576844f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F3d%252F923d620a2e2e96b72412ab040e4f12a7%252Fpa%252FCX62524_ee01eedee703caad025f0b4dc459188e.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_ee01eedee703caad025f0b4dc459188e.jpg saved to cache
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4cd04ba7-cccd-5fc2-8dda-b5df9576844f
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738533c10>
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cd04ba7-cccd-5fc2-8dda-b5df9576844f/4cd04ba7-cccd-5fc2-8dda-b5df9576844f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F3d%252F923d620a2e2e96b72412ab040e4f12a7%252Fpa%252FCX62524_0bc988fde59cc72920c497d1edeebf2c.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_0bc988fde59cc72920c497d1edeebf2c.jpg saved to cache
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4cd04ba7-cccd-5fc2-8dda-b5df9576844f
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738407ed0>
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cd04ba7-cccd-5fc2-8dda-b5df9576844f/4cd04ba7-cccd-5fc2-8dda-b5df9576844f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F3d%252F923d620a2e2e96b72412ab040e4f12a7%252Fpa%252FCX62524_0befe2d0a6d392d0bd5950d4c65542a8.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_0befe2d0a6d392d0bd5950d4c65542a8.jpg saved to cache
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4cd04ba7-cccd-5fc2-8dda-b5df9576844f
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384aa150>
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cd04ba7-cccd-5fc2-8dda-b5df9576844f/4cd04ba7-cccd-5fc2-8dda-b5df9576844f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F3d%252F923d620a2e2e96b72412ab040e4f12a7%252Fpa%252FCX62524_96e1d807426e0de10f4bdc875122036b.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_96e1d807426e0de10f4bdc875122036b.jpg saved to cache
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4cd04ba7-cccd-5fc2-8dda-b5df9576844f
2026-03-30 11:22:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4cd04ba7-cccd-5fc2-8dda-b5df9576844f, skipping ID generation
2026-03-30 11:22:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cd04ba7-cccd-5fc2-8dda-b5df9576844f with scrape type 1
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4cd04ba7-cccd-5fc2-8dda-b5df9576844f sending to next pipeline
2026-03-30 11:22:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4cd04ba7-cccd-5fc2-8dda-b5df9576844f, identifier: CX62524
2026-03-30 11:22:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4cd04ba7-cccd-5fc2-8dda-b5df9576844f with identifier: CX62524
2026-03-30 11:22:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4cd04ba7-cccd-5fc2-8dda-b5df9576844f with identifier: CX62524
2026-03-30 11:22:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4cd04ba7-cccd-5fc2-8dda-b5df9576844f with identifier: CX62524 to the API
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_96e1d807426e0de10f4bdc875122036b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:08:51Z',
'fuel_type': 'diesel',
'id': '4cd04ba7-cccd-5fc2-8dda-b5df9576844f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX62524',
'listing': 'auction',
'location': 'FR',
'make': 'Peugeot',
'model': '5008',
'odometer': 262160,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cd04ba7-cccd-5fc2-8dda-b5df9576844f/4cd04ba7-cccd-5fc2-8dda-b5df9576844f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57821,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_fb12fce5e8cbd2c5b8a2d7cfa0158581.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cd04ba7-cccd-5fc2-8dda-b5df9576844f/4cd04ba7-cccd-5fc2-8dda-b5df9576844f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60714,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_5104f56954c3c3109c2aa98e7d0a0620.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cd04ba7-cccd-5fc2-8dda-b5df9576844f/4cd04ba7-cccd-5fc2-8dda-b5df9576844f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_6c10391a51963510d527328d998a51b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cd04ba7-cccd-5fc2-8dda-b5df9576844f/4cd04ba7-cccd-5fc2-8dda-b5df9576844f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52630,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_776eeb974a05c5cd0d6b5dab02201bf0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cd04ba7-cccd-5fc2-8dda-b5df9576844f/4cd04ba7-cccd-5fc2-8dda-b5df9576844f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61793,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_edc372c887e0123936b0b33bdf658367.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cd04ba7-cccd-5fc2-8dda-b5df9576844f/4cd04ba7-cccd-5fc2-8dda-b5df9576844f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68253,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_3ededac63fd4a3105a4fd07aabf456fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cd04ba7-cccd-5fc2-8dda-b5df9576844f/4cd04ba7-cccd-5fc2-8dda-b5df9576844f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_ee01eedee703caad025f0b4dc459188e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cd04ba7-cccd-5fc2-8dda-b5df9576844f/4cd04ba7-cccd-5fc2-8dda-b5df9576844f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108640,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_0bc988fde59cc72920c497d1edeebf2c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cd04ba7-cccd-5fc2-8dda-b5df9576844f/4cd04ba7-cccd-5fc2-8dda-b5df9576844f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88008,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_0befe2d0a6d392d0bd5950d4c65542a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cd04ba7-cccd-5fc2-8dda-b5df9576844f/4cd04ba7-cccd-5fc2-8dda-b5df9576844f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88510,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/3d/923d620a2e2e96b72412ab040e4f12a7/pa/CX62524_96e1d807426e0de10f4bdc875122036b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-10-02',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 1.6 HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2011}
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX62524%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [auto1.fr] INFO: Saving data for CX62524: {'created_time': 1774869776.339411, 'last_price_update_time': 1774869776.339423, 'auction_closing_time': 1774969731.0}
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CX62524') HTTP/1.1" 204 0
2026-03-30 11:23:05 [scrapy.extensions.logstats] INFO: Crawled 185 pages (at 25 pages/min), scraped 150 items (at 15 items/min)
2026-03-30 11:23:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:23:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA64429> (referer: https://www.auto1.com/v1/car-details-view/RA64429/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8c0084f-3dd4-514b-af32-cb2550df45eb with identifier: RA64429
2026-03-30 11:23:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8c0084f-3dd4-514b-af32-cb2550df45eb with scrape type 1
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8c0084f-3dd4-514b-af32-cb2550df45eb
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe3%252Fcfe3a74566ea30f8b93660d042eb7122%252Fpa%252FRA64429_fb6dd1ef53c43a726f29d7189f5195f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_fb6dd1ef53c43a726f29d7189f5195f1.jpg not downloaded yet
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe3%252Fcfe3a74566ea30f8b93660d042eb7122%252Fpa%252FRA64429_817aae2030fda0353f17f61ec0aa4102.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_817aae2030fda0353f17f61ec0aa4102.jpg not downloaded yet
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe3%252Fcfe3a74566ea30f8b93660d042eb7122%252Fpa%252FRA64429_f5bcd2a4fc9ee8dbd3a51b672a5d3c2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_f5bcd2a4fc9ee8dbd3a51b672a5d3c2c.jpg not downloaded yet
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe3%252Fcfe3a74566ea30f8b93660d042eb7122%252Fpa%252FRA64429_dba01832338c207a0b1e009ec488b85f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_dba01832338c207a0b1e009ec488b85f.jpg not downloaded yet
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe3%252Fcfe3a74566ea30f8b93660d042eb7122%252Fpa%252FRA64429_f6d121d84d30ab0840036fa0267368b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_f6d121d84d30ab0840036fa0267368b6.jpg not downloaded yet
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe3%252Fcfe3a74566ea30f8b93660d042eb7122%252Fpa%252FRA64429_5deda9c3dbb0f7269a8ee256eea669ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_5deda9c3dbb0f7269a8ee256eea669ea.jpg not downloaded yet
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe3%252Fcfe3a74566ea30f8b93660d042eb7122%252Fpa%252FRA64429_a6fa4b8c0ea35d3484444d0906d0aacd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_a6fa4b8c0ea35d3484444d0906d0aacd.jpg not downloaded yet
2026-03-30 11:23:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_fb6dd1ef53c43a726f29d7189f5195f1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_817aae2030fda0353f17f61ec0aa4102.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe3%252Fcfe3a74566ea30f8b93660d042eb7122%252Fpa%252FRA64429_c7e3dc58bcf00326b2c163b3e78be2e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_c7e3dc58bcf00326b2c163b3e78be2e3.jpg not downloaded yet
2026-03-30 11:23:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_f5bcd2a4fc9ee8dbd3a51b672a5d3c2c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_dba01832338c207a0b1e009ec488b85f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe3%252Fcfe3a74566ea30f8b93660d042eb7122%252Fpa%252FRA64429_df63e2a7f0fbce39352cf228dc1eada6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_df63e2a7f0fbce39352cf228dc1eada6.jpg not downloaded yet
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe3%252Fcfe3a74566ea30f8b93660d042eb7122%252Fpa%252FRA64429_8ff52acdc6a44ef0216b818b63ca4f76.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_8ff52acdc6a44ef0216b818b63ca4f76.jpg not downloaded yet
2026-03-30 11:23:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_f6d121d84d30ab0840036fa0267368b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_5deda9c3dbb0f7269a8ee256eea669ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_8ff52acdc6a44ef0216b818b63ca4f76.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_df63e2a7f0fbce39352cf228dc1eada6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383e7cd0>
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c0084f-3dd4-514b-af32-cb2550df45eb/c8c0084f-3dd4-514b-af32-cb2550df45eb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe3%252Fcfe3a74566ea30f8b93660d042eb7122%252Fpa%252FRA64429_fb6dd1ef53c43a726f29d7189f5195f1.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_fb6dd1ef53c43a726f29d7189f5195f1.jpg saved to cache
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8c0084f-3dd4-514b-af32-cb2550df45eb
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385ef450>
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c0084f-3dd4-514b-af32-cb2550df45eb/c8c0084f-3dd4-514b-af32-cb2550df45eb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe3%252Fcfe3a74566ea30f8b93660d042eb7122%252Fpa%252FRA64429_817aae2030fda0353f17f61ec0aa4102.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_817aae2030fda0353f17f61ec0aa4102.jpg saved to cache
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8c0084f-3dd4-514b-af32-cb2550df45eb
2026-03-30 11:23:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_a6fa4b8c0ea35d3484444d0906d0aacd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_c7e3dc58bcf00326b2c163b3e78be2e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07387804d0>
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c0084f-3dd4-514b-af32-cb2550df45eb/c8c0084f-3dd4-514b-af32-cb2550df45eb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe3%252Fcfe3a74566ea30f8b93660d042eb7122%252Fpa%252FRA64429_f5bcd2a4fc9ee8dbd3a51b672a5d3c2c.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_f5bcd2a4fc9ee8dbd3a51b672a5d3c2c.jpg saved to cache
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8c0084f-3dd4-514b-af32-cb2550df45eb
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073875c1d0>
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c0084f-3dd4-514b-af32-cb2550df45eb/c8c0084f-3dd4-514b-af32-cb2550df45eb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe3%252Fcfe3a74566ea30f8b93660d042eb7122%252Fpa%252FRA64429_dba01832338c207a0b1e009ec488b85f.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_dba01832338c207a0b1e009ec488b85f.jpg saved to cache
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8c0084f-3dd4-514b-af32-cb2550df45eb
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383bd190>
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c0084f-3dd4-514b-af32-cb2550df45eb/c8c0084f-3dd4-514b-af32-cb2550df45eb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe3%252Fcfe3a74566ea30f8b93660d042eb7122%252Fpa%252FRA64429_f6d121d84d30ab0840036fa0267368b6.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_f6d121d84d30ab0840036fa0267368b6.jpg saved to cache
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8c0084f-3dd4-514b-af32-cb2550df45eb
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384b7610>
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c0084f-3dd4-514b-af32-cb2550df45eb/c8c0084f-3dd4-514b-af32-cb2550df45eb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe3%252Fcfe3a74566ea30f8b93660d042eb7122%252Fpa%252FRA64429_5deda9c3dbb0f7269a8ee256eea669ea.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_5deda9c3dbb0f7269a8ee256eea669ea.jpg saved to cache
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8c0084f-3dd4-514b-af32-cb2550df45eb
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383bd4d0>
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c0084f-3dd4-514b-af32-cb2550df45eb/c8c0084f-3dd4-514b-af32-cb2550df45eb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe3%252Fcfe3a74566ea30f8b93660d042eb7122%252Fpa%252FRA64429_8ff52acdc6a44ef0216b818b63ca4f76.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_8ff52acdc6a44ef0216b818b63ca4f76.jpg saved to cache
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8c0084f-3dd4-514b-af32-cb2550df45eb
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073873c090>
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c0084f-3dd4-514b-af32-cb2550df45eb/c8c0084f-3dd4-514b-af32-cb2550df45eb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe3%252Fcfe3a74566ea30f8b93660d042eb7122%252Fpa%252FRA64429_df63e2a7f0fbce39352cf228dc1eada6.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_df63e2a7f0fbce39352cf228dc1eada6.jpg saved to cache
2026-03-30 11:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8c0084f-3dd4-514b-af32-cb2550df45eb
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383be6d0>
2026-03-30 11:23:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c0084f-3dd4-514b-af32-cb2550df45eb/c8c0084f-3dd4-514b-af32-cb2550df45eb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe3%252Fcfe3a74566ea30f8b93660d042eb7122%252Fpa%252FRA64429_a6fa4b8c0ea35d3484444d0906d0aacd.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_a6fa4b8c0ea35d3484444d0906d0aacd.jpg saved to cache
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8c0084f-3dd4-514b-af32-cb2550df45eb
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073875e450>
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c0084f-3dd4-514b-af32-cb2550df45eb/c8c0084f-3dd4-514b-af32-cb2550df45eb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe3%252Fcfe3a74566ea30f8b93660d042eb7122%252Fpa%252FRA64429_c7e3dc58bcf00326b2c163b3e78be2e3.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_c7e3dc58bcf00326b2c163b3e78be2e3.jpg saved to cache
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8c0084f-3dd4-514b-af32-cb2550df45eb
2026-03-30 11:23:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8c0084f-3dd4-514b-af32-cb2550df45eb, skipping ID generation
2026-03-30 11:23:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8c0084f-3dd4-514b-af32-cb2550df45eb with scrape type 1
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8c0084f-3dd4-514b-af32-cb2550df45eb sending to next pipeline
2026-03-30 11:23:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c8c0084f-3dd4-514b-af32-cb2550df45eb, identifier: RA64429
2026-03-30 11:23:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c8c0084f-3dd4-514b-af32-cb2550df45eb with identifier: RA64429
2026-03-30 11:23:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c8c0084f-3dd4-514b-af32-cb2550df45eb with identifier: RA64429
2026-03-30 11:23:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c8c0084f-3dd4-514b-af32-cb2550df45eb with identifier: RA64429 to the API
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_c7e3dc58bcf00326b2c163b3e78be2e3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 239,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'engine_horse_power': 163,
'expiration_date': '2026-03-31T15:32:57Z',
'fuel_type': 'diesel',
'id': 'c8c0084f-3dd4-514b-af32-cb2550df45eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA64429',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Isuzu',
'model': 'D-MAX',
'odometer': 100453,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c0084f-3dd4-514b-af32-cb2550df45eb/c8c0084f-3dd4-514b-af32-cb2550df45eb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103109,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_fb6dd1ef53c43a726f29d7189f5195f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c0084f-3dd4-514b-af32-cb2550df45eb/c8c0084f-3dd4-514b-af32-cb2550df45eb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_817aae2030fda0353f17f61ec0aa4102.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c0084f-3dd4-514b-af32-cb2550df45eb/c8c0084f-3dd4-514b-af32-cb2550df45eb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_f5bcd2a4fc9ee8dbd3a51b672a5d3c2c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c0084f-3dd4-514b-af32-cb2550df45eb/c8c0084f-3dd4-514b-af32-cb2550df45eb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85709,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_dba01832338c207a0b1e009ec488b85f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c0084f-3dd4-514b-af32-cb2550df45eb/c8c0084f-3dd4-514b-af32-cb2550df45eb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85655,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_f6d121d84d30ab0840036fa0267368b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c0084f-3dd4-514b-af32-cb2550df45eb/c8c0084f-3dd4-514b-af32-cb2550df45eb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_5deda9c3dbb0f7269a8ee256eea669ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c0084f-3dd4-514b-af32-cb2550df45eb/c8c0084f-3dd4-514b-af32-cb2550df45eb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92796,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_a6fa4b8c0ea35d3484444d0906d0aacd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c0084f-3dd4-514b-af32-cb2550df45eb/c8c0084f-3dd4-514b-af32-cb2550df45eb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_c7e3dc58bcf00326b2c163b3e78be2e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c0084f-3dd4-514b-af32-cb2550df45eb/c8c0084f-3dd4-514b-af32-cb2550df45eb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113561,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_df63e2a7f0fbce39352cf228dc1eada6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c0084f-3dd4-514b-af32-cb2550df45eb/c8c0084f-3dd4-514b-af32-cb2550df45eb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/e3/cfe3a74566ea30f8b93660d042eb7122/pa/RA64429_8ff52acdc6a44ef0216b818b63ca4f76.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-05-15',
'seats_number': 4,
'seller_name': None,
'title': 'Isuzu D-MAX 1.9 Turbodiesel Double Cab 4WD L',
'transmission': 'automatic',
'trim': 'Double Cab 4WD L',
'year': 2023}
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA64429%27 HTTP/1.1" 200 None
2026-03-30 11:23:11 [auto1.fr] INFO: Saving data for RA64429: {'created_time': 1774869791.564038, 'last_price_update_time': 1774869791.564049, 'auction_closing_time': 1774971177.0}
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RA64429') HTTP/1.1" 204 0
2026-03-30 11:23:34 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.944(s), this was the 2nd time calling it.
2026-03-30 11:23:34 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.616452883123409 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:23:36 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.138(s), this was the 1st time calling it.
2026-03-30 11:23:36 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.074639980680716 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:23:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:23:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:24:05 [scrapy.extensions.logstats] INFO: Crawled 186 pages (at 1 pages/min), scraped 151 items (at 1 items/min)
2026-03-30 11:24:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:24:07 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.038(s), this was the 1st time calling it.
2026-03-30 11:24:07 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.132941275695516 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:24:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:24:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.352(s), this was the 1st time calling it.
2026-03-30 11:24:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.448751164147168 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:24:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:24:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:25 [auto1.fr] INFO: Channel: 24h | Page: 17 | totalHits: 5583 | hits on page: 40
2026-03-30 11:24:25 [auto1.fr] INFO: Found listing with ID: GE60554
2026-03-30 11:24:25 [auto1.fr] INFO: Found listing with ID: MV42636
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV42636%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.fr] INFO: Scrape type for MV42636: 0
2026-03-30 11:24:25 [auto1.fr] INFO: Found listing with ID: ZN76101
2026-03-30 11:24:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:25 [auto1.fr] INFO: Found listing with ID: RU12813
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU12813%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.fr] INFO: Scrape type for RU12813: 0
2026-03-30 11:24:25 [auto1.fr] INFO: Found listing with ID: CG93824
2026-03-30 11:24:25 [auto1.fr] INFO: Found listing with ID: FB52625
2026-03-30 11:24:25 [auto1.fr] INFO: Found listing with ID: RN59979
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN59979%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.fr] INFO: Scrape type for RN59979: 1
2026-03-30 11:24:25 [auto1.fr] INFO: Found listing with ID: BW84332
2026-03-30 11:24:25 [auto1.fr] INFO: Found listing with ID: LP57691
2026-03-30 11:24:25 [auto1.fr] INFO: Found listing with ID: HL77314
2026-03-30 11:24:25 [auto1.fr] INFO: Found listing with ID: VL59917
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL59917%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.fr] INFO: Scrape type for VL59917: 2
2026-03-30 11:24:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 640b94d4-dff1-5d52-8866-3bee9a2a7bb4 with identifier: VL59917
2026-03-30 11:24:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 640b94d4-dff1-5d52-8866-3bee9a2a7bb4 with scrape type 2
2026-03-30 11:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 640b94d4-dff1-5d52-8866-3bee9a2a7bb4 with scrape type 2
2026-03-30 11:24:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 640b94d4-dff1-5d52-8866-3bee9a2a7bb4, identifier: VL59917
2026-03-30 11:24:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 640b94d4-dff1-5d52-8866-3bee9a2a7bb4 with identifier: VL59917
2026-03-30 11:24:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 640b94d4-dff1-5d52-8866-3bee9a2a7bb4 with identifier: VL59917
2026-03-30 11:24:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 640b94d4-dff1-5d52-8866-3bee9a2a7bb4 with identifier: VL59917 to the API
2026-03-30 11:24:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:21:34Z',
'fuel_type': 'diesel',
'id': '640b94d4-dff1-5d52-8866-3bee9a2a7bb4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL59917',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 220437,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-29',
'seller_name': None,
'title': 'Peugeot 3008 1.6 HDi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2013}
2026-03-30 11:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL59917%27 HTTP/1.1" 200 None
2026-03-30 11:24:26 [auto1.fr] INFO: Saving data for VL59917: {'auction_closing_time': 1774970494.0, 'created_time': 1774296784.821919, 'last_price_update_time': 1774869866.388381}
2026-03-30 11:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VL59917') HTTP/1.1" 204 0
2026-03-30 11:24:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:26 [auto1.fr] INFO: Found listing with ID: BW58605
2026-03-30 11:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BW58605%27 HTTP/1.1" 200 None
2026-03-30 11:24:26 [auto1.fr] INFO: Scrape type for BW58605: 1
2026-03-30 11:24:26 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.461(s), this was the 1st time calling it.
2026-03-30 11:24:26 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.914274063609209 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:24:26 [auto1.fr] INFO: Found listing with ID: SP58903
2026-03-30 11:24:26 [auto1.fr] INFO: Found listing with ID: GD64881
2026-03-30 11:24:26 [auto1.fr] INFO: Found listing with ID: DS29137
2026-03-30 11:24:26 [auto1.fr] INFO: Found listing with ID: AW56148
2026-03-30 11:24:26 [auto1.fr] INFO: Found listing with ID: TE60628
2026-03-30 11:24:26 [auto1.fr] INFO: Found listing with ID: HX53685
2026-03-30 11:24:26 [auto1.fr] INFO: Found listing with ID: FJ07726
2026-03-30 11:24:26 [auto1.fr] INFO: Found listing with ID: TK65775
2026-03-30 11:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK65775%27 HTTP/1.1" 200 None
2026-03-30 11:24:26 [auto1.fr] INFO: Scrape type for TK65775: 1
2026-03-30 11:24:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:26 [auto1.fr] INFO: Found listing with ID: MY85947
2026-03-30 11:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MY85947%27 HTTP/1.1" 200 None
2026-03-30 11:24:26 [auto1.fr] INFO: Scrape type for MY85947: 1
2026-03-30 11:24:26 [auto1.fr] INFO: Found listing with ID: VG52594
2026-03-30 11:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG52594%27 HTTP/1.1" 200 None
2026-03-30 11:24:26 [auto1.fr] INFO: Scrape type for VG52594: 2
2026-03-30 11:24:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57afb1a5-db0d-5b59-8ffe-58e7ce40ebe5 with identifier: VG52594
2026-03-30 11:24:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57afb1a5-db0d-5b59-8ffe-58e7ce40ebe5 with scrape type 2
2026-03-30 11:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57afb1a5-db0d-5b59-8ffe-58e7ce40ebe5 with scrape type 2
2026-03-30 11:24:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 57afb1a5-db0d-5b59-8ffe-58e7ce40ebe5, identifier: VG52594
2026-03-30 11:24:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 57afb1a5-db0d-5b59-8ffe-58e7ce40ebe5 with identifier: VG52594
2026-03-30 11:24:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 57afb1a5-db0d-5b59-8ffe-58e7ce40ebe5 with identifier: VG52594
2026-03-30 11:24:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 57afb1a5-db0d-5b59-8ffe-58e7ce40ebe5 with identifier: VG52594 to the API
2026-03-30 11:24:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-31T15:51:32Z',
'fuel_type': 'petrol',
'id': '57afb1a5-db0d-5b59-8ffe-58e7ce40ebe5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG52594',
'listing': 'auction',
'make': 'Ford',
'model': 'Puma',
'odometer': 37031,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-15',
'seller_name': None,
'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid Vivid Ruby Edition',
'transmission': 'manual',
'trim': 'Vivid Ruby Edition',
'year': 2023}
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG52594%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.fr] INFO: Saving data for VG52594: {'auction_closing_time': 1774972292.0, 'created_time': 1774298198.637665, 'last_price_update_time': 1774869867.160395}
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VG52594') HTTP/1.1" 204 0
2026-03-30 11:24:27 [auto1.fr] INFO: Found listing with ID: KH02703
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH02703%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.fr] INFO: Scrape type for KH02703: 1
2026-03-30 11:24:27 [auto1.fr] INFO: Found listing with ID: FG53432
2026-03-30 11:24:27 [auto1.fr] INFO: Found listing with ID: UE64879
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UE64879%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.fr] INFO: Scrape type for UE64879: 1
2026-03-30 11:24:27 [auto1.fr] INFO: Found listing with ID: WN89162
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN89162%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.fr] INFO: Scrape type for WN89162: 2
2026-03-30 11:24:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32110f1e-3b31-5bdf-bd9f-29b3061f2451 with identifier: WN89162
2026-03-30 11:24:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32110f1e-3b31-5bdf-bd9f-29b3061f2451 with scrape type 2
2026-03-30 11:24:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32110f1e-3b31-5bdf-bd9f-29b3061f2451 with scrape type 2
2026-03-30 11:24:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 32110f1e-3b31-5bdf-bd9f-29b3061f2451, identifier: WN89162
2026-03-30 11:24:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 32110f1e-3b31-5bdf-bd9f-29b3061f2451 with identifier: WN89162
2026-03-30 11:24:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 32110f1e-3b31-5bdf-bd9f-29b3061f2451 with identifier: WN89162
2026-03-30 11:24:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 32110f1e-3b31-5bdf-bd9f-29b3061f2451 with identifier: WN89162 to the API
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:32:03Z',
'fuel_type': 'diesel',
'id': '32110f1e-3b31-5bdf-bd9f-29b3061f2451',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN89162',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 114267,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-08',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2020}
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN89162%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.fr] INFO: Saving data for WN89162: {'auction_closing_time': 1774971123.0, 'created_time': 1772735484.96948, 'last_price_update_time': 1774869867.795442}
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WN89162') HTTP/1.1" 204 0
2026-03-30 11:24:27 [auto1.fr] INFO: Found listing with ID: CB03535
2026-03-30 11:24:27 [auto1.fr] INFO: Found listing with ID: KF51820
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF51820%27 HTTP/1.1" 200 None
2026-03-30 11:24:27 [auto1.fr] INFO: Scrape type for KF51820: 2
2026-03-30 11:24:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81575367-734c-528a-98ee-1c9c9a0226b8 with identifier: KF51820
2026-03-30 11:24:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81575367-734c-528a-98ee-1c9c9a0226b8 with scrape type 2
2026-03-30 11:24:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81575367-734c-528a-98ee-1c9c9a0226b8 with scrape type 2
2026-03-30 11:24:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 81575367-734c-528a-98ee-1c9c9a0226b8, identifier: KF51820
2026-03-30 11:24:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 81575367-734c-528a-98ee-1c9c9a0226b8 with identifier: KF51820
2026-03-30 11:24:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 81575367-734c-528a-98ee-1c9c9a0226b8 with identifier: KF51820
2026-03-30 11:24:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 81575367-734c-528a-98ee-1c9c9a0226b8 with identifier: KF51820 to the API
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:38:42Z',
'fuel_type': 'petrol',
'id': '81575367-734c-528a-98ee-1c9c9a0226b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF51820',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 65654,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-20',
'seller_name': None,
'title': 'Opel Corsa 1.2 Edition Business',
'transmission': 'manual',
'trim': 'Edition Business',
'year': 2021}
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF51820%27 HTTP/1.1" 200 None
2026-03-30 11:24:28 [auto1.fr] INFO: Saving data for KF51820: {'auction_closing_time': 1774971522.0, 'created_time': 1773648364.752537, 'last_price_update_time': 1774869868.228404}
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KF51820') HTTP/1.1" 204 0
2026-03-30 11:24:28 [auto1.fr] INFO: Found listing with ID: NP05223
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP05223%27 HTTP/1.1" 200 None
2026-03-30 11:24:28 [auto1.fr] INFO: Scrape type for NP05223: 2
2026-03-30 11:24:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73980909-8bae-5e78-9e2c-8cf09d6272de with identifier: NP05223
2026-03-30 11:24:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73980909-8bae-5e78-9e2c-8cf09d6272de with scrape type 2
2026-03-30 11:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73980909-8bae-5e78-9e2c-8cf09d6272de with scrape type 2
2026-03-30 11:24:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 73980909-8bae-5e78-9e2c-8cf09d6272de, identifier: NP05223
2026-03-30 11:24:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 73980909-8bae-5e78-9e2c-8cf09d6272de with identifier: NP05223
2026-03-30 11:24:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 73980909-8bae-5e78-9e2c-8cf09d6272de with identifier: NP05223
2026-03-30 11:24:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 73980909-8bae-5e78-9e2c-8cf09d6272de with identifier: NP05223 to the API
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-31T15:59:23Z',
'fuel_type': 'diesel',
'id': '73980909-8bae-5e78-9e2c-8cf09d6272de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP05223',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 259754,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-10',
'seller_name': None,
'title': 'Toyota RAV 4 2.0 D-4D Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2014}
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP05223%27 HTTP/1.1" 200 None
2026-03-30 11:24:28 [auto1.fr] INFO: Saving data for NP05223: {'auction_closing_time': 1774972763.0, 'created_time': 1774382756.704542, 'last_price_update_time': 1774869868.665244}
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NP05223') HTTP/1.1" 204 0
2026-03-30 11:24:28 [auto1.fr] INFO: Found listing with ID: ZW51272
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW51272%27 HTTP/1.1" 200 None
2026-03-30 11:24:28 [auto1.fr] INFO: Scrape type for ZW51272: 1
2026-03-30 11:24:28 [auto1.fr] INFO: Found listing with ID: AW82700
2026-03-30 11:24:28 [auto1.fr] INFO: Found listing with ID: LF08088
2026-03-30 11:24:28 [auto1.fr] INFO: Found listing with ID: RA43033
2026-03-30 11:24:28 [auto1.fr] INFO: Found listing with ID: AT92425
2026-03-30 11:24:28 [auto1.fr] INFO: Found listing with ID: GZ04122
2026-03-30 11:24:28 [auto1.fr] INFO: Found listing with ID: DB27239
2026-03-30 11:24:28 [auto1.fr] INFO: Found listing with ID: CG67141
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG67141%27 HTTP/1.1" 200 None
2026-03-30 11:24:28 [auto1.fr] INFO: Scrape type for CG67141: 1
2026-03-30 11:24:28 [auto1.fr] INFO: Found listing with ID: BH16535
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH16535%27 HTTP/1.1" 200 None
2026-03-30 11:24:28 [auto1.fr] INFO: Scrape type for BH16535: 2
2026-03-30 11:24:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b573ab47-01d3-5092-b7f2-c1dd2009f799 with identifier: BH16535
2026-03-30 11:24:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b573ab47-01d3-5092-b7f2-c1dd2009f799 with scrape type 2
2026-03-30 11:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b573ab47-01d3-5092-b7f2-c1dd2009f799 with scrape type 2
2026-03-30 11:24:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b573ab47-01d3-5092-b7f2-c1dd2009f799, identifier: BH16535
2026-03-30 11:24:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b573ab47-01d3-5092-b7f2-c1dd2009f799 with identifier: BH16535
2026-03-30 11:24:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b573ab47-01d3-5092-b7f2-c1dd2009f799 with identifier: BH16535
2026-03-30 11:24:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b573ab47-01d3-5092-b7f2-c1dd2009f799 with identifier: BH16535 to the API
2026-03-30 11:24:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:45:32Z',
'fuel_type': 'diesel',
'id': 'b573ab47-01d3-5092-b7f2-c1dd2009f799',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH16535',
'listing': 'auction',
'make': 'Honda',
'model': 'Civic',
'odometer': 168215,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-27',
'seller_name': None,
'title': 'Honda Civic 2.2 CTDI Virtuose',
'transmission': 'manual',
'trim': 'Virtuose',
'year': 2011}
2026-03-30 11:24:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH16535%27 HTTP/1.1" 200 None
2026-03-30 11:24:29 [auto1.fr] INFO: Saving data for BH16535: {'auction_closing_time': 1774971932.0, 'created_time': 1773691597.965563, 'last_price_update_time': 1774869869.683962}
2026-03-30 11:24:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BH16535') HTTP/1.1" 204 0
2026-03-30 11:24:29 [auto1.fr] INFO: Found listing with ID: GS18413
2026-03-30 11:24:29 [auto1.fr] INFO: Found listing with ID: JV34550
2026-03-30 11:24:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV34550%27 HTTP/1.1" 200 None
2026-03-30 11:24:29 [auto1.fr] INFO: Scrape type for JV34550: 1
2026-03-30 11:24:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:30 [auto1.fr] INFO: Channel: 24h | Page: 18 | totalHits: 5583 | hits on page: 40
2026-03-30 11:24:30 [auto1.fr] INFO: Found listing with ID: ER38330
2026-03-30 11:24:30 [auto1.fr] INFO: Found listing with ID: FJ22244
2026-03-30 11:24:30 [auto1.fr] INFO: Found listing with ID: LX65836
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX65836%27 HTTP/1.1" 200 None
2026-03-30 11:24:30 [auto1.fr] INFO: Scrape type for LX65836: 1
2026-03-30 11:24:30 [auto1.fr] INFO: Found listing with ID: DP63747
2026-03-30 11:24:30 [auto1.fr] INFO: Found listing with ID: ZG20237
2026-03-30 11:24:30 [auto1.fr] INFO: Found listing with ID: AW25296
2026-03-30 11:24:30 [auto1.fr] INFO: Found listing with ID: RY21816
2026-03-30 11:24:30 [auto1.fr] INFO: Found listing with ID: VS89734
2026-03-30 11:24:30 [auto1.fr] INFO: Found listing with ID: EU27983
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU27983%27 HTTP/1.1" 200 None
2026-03-30 11:24:30 [auto1.fr] INFO: Scrape type for EU27983: 2
2026-03-30 11:24:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db88ef6b-e8ca-5235-9733-302c4c4bf123 with identifier: EU27983
2026-03-30 11:24:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db88ef6b-e8ca-5235-9733-302c4c4bf123 with scrape type 2
2026-03-30 11:24:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db88ef6b-e8ca-5235-9733-302c4c4bf123 with scrape type 2
2026-03-30 11:24:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: db88ef6b-e8ca-5235-9733-302c4c4bf123, identifier: EU27983
2026-03-30 11:24:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: db88ef6b-e8ca-5235-9733-302c4c4bf123 with identifier: EU27983
2026-03-30 11:24:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: db88ef6b-e8ca-5235-9733-302c4c4bf123 with identifier: EU27983
2026-03-30 11:24:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: db88ef6b-e8ca-5235-9733-302c4c4bf123 with identifier: EU27983 to the API
2026-03-30 11:24:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-31T15:54:34Z',
'fuel_type': 'hybrid',
'id': 'db88ef6b-e8ca-5235-9733-302c4c4bf123',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU27983',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 118076,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-18',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 300e 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2020}
2026-03-30 11:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU27983%27 HTTP/1.1" 200 None
2026-03-30 11:24:31 [auto1.fr] INFO: Saving data for EU27983: {'auction_closing_time': 1774972474.0, 'created_time': 1773400583.833879, 'last_price_update_time': 1774869871.663659}
2026-03-30 11:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EU27983') HTTP/1.1" 204 0
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: YG27140
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: FV30142
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: KF38228
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: LT07555
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: GL54239
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: GC36158
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: YY74823
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: GP91478
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: NP08318
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: XC44786
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: BD89729
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: PV10866
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: MV42781
2026-03-30 11:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV42781%27 HTTP/1.1" 200 None
2026-03-30 11:24:31 [auto1.fr] INFO: Scrape type for MV42781: 1
2026-03-30 11:24:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: WX31823
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: GD81242
2026-03-30 11:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD81242%27 HTTP/1.1" 200 None
2026-03-30 11:24:31 [auto1.fr] INFO: Scrape type for GD81242: 1
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: DH43299
2026-03-30 11:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH43299%27 HTTP/1.1" 200 None
2026-03-30 11:24:31 [auto1.fr] INFO: Scrape type for DH43299: 1
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: EE45752
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: MN56014
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: DD87525
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: JR34366
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: SC12809
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: EW99844
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: AW44269
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: KB70829
2026-03-30 11:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB70829%27 HTTP/1.1" 200 None
2026-03-30 11:24:31 [auto1.fr] INFO: Scrape type for KB70829: 1
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: VY12323
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: JS02864
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: JE60275
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: TP56731
2026-03-30 11:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP56731%27 HTTP/1.1" 200 None
2026-03-30 11:24:31 [auto1.fr] INFO: Scrape type for TP56731: 1
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: SL97840
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: UF15534
2026-03-30 11:24:31 [auto1.fr] INFO: Found listing with ID: YT50077
2026-03-30 11:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT50077%27 HTTP/1.1" 200 None
2026-03-30 11:24:31 [auto1.fr] INFO: Scrape type for YT50077: 1
2026-03-30 11:24:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TK65775/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:38 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.833(s), this was the 1st time calling it.
2026-03-30 11:24:38 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.660160996659136 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:24:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BW58605/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN59979/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH02703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MY85947/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:24:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UE64879/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN76101/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL28829/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:44 [auto1.fr] INFO: Channel: 24h | Page: 19 | totalHits: 5583 | hits on page: 40
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: NE75064
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: HL20031
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: MC54002
2026-03-30 11:24:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC54002%27 HTTP/1.1" 200 None
2026-03-30 11:24:44 [auto1.fr] INFO: Scrape type for MC54002: 1
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: VX18119
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: GG26646
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: TL75170
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: EA77824
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: CT12703
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: SU76987
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: NU85772
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: TU91399
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: LE79705
2026-03-30 11:24:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LE79705%27 HTTP/1.1" 200 None
2026-03-30 11:24:44 [auto1.fr] INFO: Scrape type for LE79705: 1
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: VV72434
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: CH43264
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: CB36786
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: RX13312
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: DK51089
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: PB02514
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: JF13819
2026-03-30 11:24:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF13819%27 HTTP/1.1" 200 None
2026-03-30 11:24:44 [auto1.fr] INFO: Scrape type for JF13819: 1
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: EC34278
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: WF80383
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: SB53559
2026-03-30 11:24:44 [auto1.fr] INFO: Found listing with ID: GG43203
2026-03-30 11:24:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG43203%27 HTTP/1.1" 200 None
2026-03-30 11:24:44 [auto1.fr] INFO: Scrape type for GG43203: 2
2026-03-30 11:24:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9188f212-c7a6-51f3-a045-ce43140e4939 with identifier: GG43203
2026-03-30 11:24:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9188f212-c7a6-51f3-a045-ce43140e4939 with scrape type 2
2026-03-30 11:24:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9188f212-c7a6-51f3-a045-ce43140e4939 with scrape type 2
2026-03-30 11:24:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9188f212-c7a6-51f3-a045-ce43140e4939, identifier: GG43203
2026-03-30 11:24:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9188f212-c7a6-51f3-a045-ce43140e4939 with identifier: GG43203
2026-03-30 11:24:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9188f212-c7a6-51f3-a045-ce43140e4939 with identifier: GG43203
2026-03-30 11:24:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9188f212-c7a6-51f3-a045-ce43140e4939 with identifier: GG43203 to the API
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:35:36Z',
'fuel_type': 'petrol',
'id': '9188f212-c7a6-51f3-a045-ce43140e4939',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG43203',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 127920,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-26',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2018}
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG43203%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.fr] INFO: Saving data for GG43203: {'auction_closing_time': 1774971336.0, 'created_time': 1773078210.149781, 'last_price_update_time': 1774869885.319158}
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GG43203') HTTP/1.1" 204 0
2026-03-30 11:24:45 [auto1.fr] INFO: Found listing with ID: NN21881
2026-03-30 11:24:45 [auto1.fr] INFO: Found listing with ID: ET30983
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET30983%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.fr] INFO: Scrape type for ET30983: 2
2026-03-30 11:24:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07257bde-447e-5001-9e3c-ea5085a867fb with identifier: ET30983
2026-03-30 11:24:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07257bde-447e-5001-9e3c-ea5085a867fb with scrape type 2
2026-03-30 11:24:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07257bde-447e-5001-9e3c-ea5085a867fb with scrape type 2
2026-03-30 11:24:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 07257bde-447e-5001-9e3c-ea5085a867fb, identifier: ET30983
2026-03-30 11:24:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 07257bde-447e-5001-9e3c-ea5085a867fb with identifier: ET30983
2026-03-30 11:24:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 07257bde-447e-5001-9e3c-ea5085a867fb with identifier: ET30983
2026-03-30 11:24:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 07257bde-447e-5001-9e3c-ea5085a867fb with identifier: ET30983 to the API
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:37:30Z',
'fuel_type': 'diesel',
'id': '07257bde-447e-5001-9e3c-ea5085a867fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET30983',
'listing': 'auction',
'make': 'Renault',
'model': 'Master',
'odometer': 42190,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-18',
'seller_name': None,
'title': 'Renault Master 2.3 dCi L2H2 3,3 Grand Confort',
'transmission': 'manual',
'trim': 'L2H2 3,3 Grand Confort',
'year': 2021}
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET30983%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.fr] INFO: Saving data for ET30983: {'auction_closing_time': 1774971450.0, 'created_time': 1773253870.728076, 'last_price_update_time': 1774869885.878355}
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ET30983') HTTP/1.1" 204 0
2026-03-30 11:24:45 [auto1.fr] INFO: Found listing with ID: JS22176
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JS22176%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.fr] INFO: Scrape type for JS22176: 1
2026-03-30 11:24:45 [auto1.fr] INFO: Found listing with ID: VS20220
2026-03-30 11:24:45 [auto1.fr] INFO: Found listing with ID: TK02399
2026-03-30 11:24:45 [auto1.fr] INFO: Found listing with ID: PH49145
2026-03-30 11:24:45 [auto1.fr] INFO: Found listing with ID: ZE29063
2026-03-30 11:24:45 [auto1.fr] INFO: Found listing with ID: ZV46129
2026-03-30 11:24:45 [auto1.fr] INFO: Found listing with ID: PM66643
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM66643%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.fr] INFO: Scrape type for PM66643: 1
2026-03-30 11:24:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX64079/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:45 [auto1.fr] INFO: Found listing with ID: SM48781
2026-03-30 11:24:45 [auto1.fr] INFO: Found listing with ID: XD68229
2026-03-30 11:24:45 [auto1.fr] INFO: Found listing with ID: LS37547
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LS37547%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.fr] INFO: Scrape type for LS37547: 1
2026-03-30 11:24:45 [auto1.fr] INFO: Found listing with ID: YH14839
2026-03-30 11:24:45 [auto1.fr] INFO: Found listing with ID: RK82051
2026-03-30 11:24:45 [auto1.fr] INFO: Found listing with ID: YL06097
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL06097%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.fr] INFO: Scrape type for YL06097: 1
2026-03-30 11:24:45 [auto1.fr] INFO: Found listing with ID: SK43844
2026-03-30 11:24:45 [auto1.fr] INFO: Found listing with ID: FX27811
2026-03-30 11:24:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TK65775> (referer: https://www.auto1.com/v1/car-details-view/TK65775/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83f1bf63-5b9b-5c84-b66c-bba642d36bc5 with identifier: TK65775
2026-03-30 11:24:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83f1bf63-5b9b-5c84-b66c-bba642d36bc5 with scrape type 1
2026-03-30 11:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 83f1bf63-5b9b-5c84-b66c-bba642d36bc5
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd5%252Ffad5961bfc6f142dc11136ff2e6c6109%252Fpa%252FTK65775_50c9273df9785c41b2f7015dc64b00c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_50c9273df9785c41b2f7015dc64b00c1.jpg already downloaded
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd5%252Ffad5961bfc6f142dc11136ff2e6c6109%252Fpa%252FTK65775_06d192facf29a7f560e22d6fa29adcbe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_06d192facf29a7f560e22d6fa29adcbe.jpg already downloaded
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd5%252Ffad5961bfc6f142dc11136ff2e6c6109%252Fpa%252FTK65775_7d89a4282b9fb1476dbe4b60929d8fb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_7d89a4282b9fb1476dbe4b60929d8fb5.jpg already downloaded
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd5%252Ffad5961bfc6f142dc11136ff2e6c6109%252Fpa%252FTK65775_e5025f068bed2d3ee5b1267704871505.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_e5025f068bed2d3ee5b1267704871505.jpg already downloaded
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd5%252Ffad5961bfc6f142dc11136ff2e6c6109%252Fpa%252FTK65775_64040c42ab38a5c527feb89c0002c472.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_64040c42ab38a5c527feb89c0002c472.jpg already downloaded
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd5%252Ffad5961bfc6f142dc11136ff2e6c6109%252Fpa%252FTK65775_afe32f328fe7bc15371d5926f3d670c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_afe32f328fe7bc15371d5926f3d670c8.jpg already downloaded
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd5%252Ffad5961bfc6f142dc11136ff2e6c6109%252Fpa%252FTK65775_3520c014bb63cd413a2fc13357c86ad9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_3520c014bb63cd413a2fc13357c86ad9.jpg already downloaded
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd5%252Ffad5961bfc6f142dc11136ff2e6c6109%252Fpa%252FTK65775_d7468b764c24034de582b8b5e81638ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_d7468b764c24034de582b8b5e81638ef.jpg already downloaded
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd5%252Ffad5961bfc6f142dc11136ff2e6c6109%252Fpa%252FTK65775_5f16bae8ff14135961a793c12824b1bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_5f16bae8ff14135961a793c12824b1bc.jpg already downloaded
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd5%252Ffad5961bfc6f142dc11136ff2e6c6109%252Fpa%252FTK65775_6a8ce4fdd5110c9da4fd97c0f9308229.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_6a8ce4fdd5110c9da4fd97c0f9308229.jpg already downloaded
2026-03-30 11:24:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 83f1bf63-5b9b-5c84-b66c-bba642d36bc5, identifier: TK65775
2026-03-30 11:24:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 83f1bf63-5b9b-5c84-b66c-bba642d36bc5 with identifier: TK65775
2026-03-30 11:24:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 83f1bf63-5b9b-5c84-b66c-bba642d36bc5 with identifier: TK65775
2026-03-30 11:24:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 83f1bf63-5b9b-5c84-b66c-bba642d36bc5 with identifier: TK65775 to the API
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TK65775>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:55:43Z',
'fuel_type': 'diesel',
'id': '83f1bf63-5b9b-5c84-b66c-bba642d36bc5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK65775',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Peugeot',
'model': 'Partner',
'odometer': 202110,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photo_urls': ['https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_50c9273df9785c41b2f7015dc64b00c1.jpg',
'https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_06d192facf29a7f560e22d6fa29adcbe.jpg',
'https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_7d89a4282b9fb1476dbe4b60929d8fb5.jpg',
'https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_e5025f068bed2d3ee5b1267704871505.jpg',
'https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_64040c42ab38a5c527feb89c0002c472.jpg',
'https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_afe32f328fe7bc15371d5926f3d670c8.jpg',
'https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_3520c014bb63cd413a2fc13357c86ad9.jpg',
'https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_d7468b764c24034de582b8b5e81638ef.jpg',
'https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_5f16bae8ff14135961a793c12824b1bc.jpg',
'https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_6a8ce4fdd5110c9da4fd97c0f9308229.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83f1bf63-5b9b-5c84-b66c-bba642d36bc5/83f1bf63-5b9b-5c84-b66c-bba642d36bc5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53463,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_50c9273df9785c41b2f7015dc64b00c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83f1bf63-5b9b-5c84-b66c-bba642d36bc5/83f1bf63-5b9b-5c84-b66c-bba642d36bc5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51240,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_06d192facf29a7f560e22d6fa29adcbe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83f1bf63-5b9b-5c84-b66c-bba642d36bc5/83f1bf63-5b9b-5c84-b66c-bba642d36bc5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51994,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_7d89a4282b9fb1476dbe4b60929d8fb5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83f1bf63-5b9b-5c84-b66c-bba642d36bc5/83f1bf63-5b9b-5c84-b66c-bba642d36bc5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_e5025f068bed2d3ee5b1267704871505.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83f1bf63-5b9b-5c84-b66c-bba642d36bc5/83f1bf63-5b9b-5c84-b66c-bba642d36bc5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_64040c42ab38a5c527feb89c0002c472.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83f1bf63-5b9b-5c84-b66c-bba642d36bc5/83f1bf63-5b9b-5c84-b66c-bba642d36bc5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51834,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_afe32f328fe7bc15371d5926f3d670c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83f1bf63-5b9b-5c84-b66c-bba642d36bc5/83f1bf63-5b9b-5c84-b66c-bba642d36bc5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49169,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_3520c014bb63cd413a2fc13357c86ad9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83f1bf63-5b9b-5c84-b66c-bba642d36bc5/83f1bf63-5b9b-5c84-b66c-bba642d36bc5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_d7468b764c24034de582b8b5e81638ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83f1bf63-5b9b-5c84-b66c-bba642d36bc5/83f1bf63-5b9b-5c84-b66c-bba642d36bc5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93712,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_5f16bae8ff14135961a793c12824b1bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83f1bf63-5b9b-5c84-b66c-bba642d36bc5/83f1bf63-5b9b-5c84-b66c-bba642d36bc5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76367,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/d5/fad5961bfc6f142dc11136ff2e6c6109/pa/TK65775_6a8ce4fdd5110c9da4fd97c0f9308229.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-05-04',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot Partner 1.6 HDi Zénith',
'transmission': 'manual',
'trim': 'Zénith',
'year': 2010}
2026-03-30 11:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK65775%27 HTTP/1.1" 200 None
2026-03-30 11:24:48 [auto1.fr] INFO: Saving data for TK65775: {'created_time': 1774869888.152882, 'last_price_update_time': 1774869888.152892, 'auction_closing_time': 1774972543.0}
2026-03-30 11:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TK65775') HTTP/1.1" 204 0
2026-03-30 11:24:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JV34550/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YT50077/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN59979> (referer: https://www.auto1.com/v1/car-details-view/RN59979/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9ffc469-d2ba-590b-8c43-24db6ad38714 with identifier: RN59979
2026-03-30 11:24:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9ffc469-d2ba-590b-8c43-24db6ad38714 with scrape type 1
2026-03-30 11:24:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9ffc469-d2ba-590b-8c43-24db6ad38714
2026-03-30 11:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F9b%252F569b3cecde27da1afa5d1a171d28c194%252Fpa%252FRN59979_37bf4382ea89fd3fe57ba83529fd501f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_37bf4382ea89fd3fe57ba83529fd501f.jpg not downloaded yet
2026-03-30 11:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F9b%252F569b3cecde27da1afa5d1a171d28c194%252Fpa%252FRN59979_8260373db10347a01ade231e25b7f09c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_8260373db10347a01ade231e25b7f09c.jpg not downloaded yet
2026-03-30 11:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F9b%252F569b3cecde27da1afa5d1a171d28c194%252Fpa%252FRN59979_96d99fe6d6f9e57dca626fa6ac20ce0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_96d99fe6d6f9e57dca626fa6ac20ce0d.jpg not downloaded yet
2026-03-30 11:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F9b%252F569b3cecde27da1afa5d1a171d28c194%252Fpa%252FRN59979_e995ed0f65acabd621574bd489851cc5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_e995ed0f65acabd621574bd489851cc5.jpg not downloaded yet
2026-03-30 11:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F9b%252F569b3cecde27da1afa5d1a171d28c194%252Fpa%252FRN59979_96ab3f8e671f7672c83342ba9fcd0a29.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_96ab3f8e671f7672c83342ba9fcd0a29.jpg not downloaded yet
2026-03-30 11:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F9b%252F569b3cecde27da1afa5d1a171d28c194%252Fpa%252FRN59979_c51f3326a5a0a29d13139e63c384aa4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_c51f3326a5a0a29d13139e63c384aa4e.jpg not downloaded yet
2026-03-30 11:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F9b%252F569b3cecde27da1afa5d1a171d28c194%252Fpa%252FRN59979_9db9cae2080e1689c97df4bafbaf1abc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_9db9cae2080e1689c97df4bafbaf1abc.jpg not downloaded yet
2026-03-30 11:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F9b%252F569b3cecde27da1afa5d1a171d28c194%252Fpa%252FRN59979_f57af2c027c761d7bc83045fde4b717b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_f57af2c027c761d7bc83045fde4b717b.jpg not downloaded yet
2026-03-30 11:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F9b%252F569b3cecde27da1afa5d1a171d28c194%252Fpa%252FRN59979_7d76853def79a4ecf4626e9580a22e97.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_7d76853def79a4ecf4626e9580a22e97.jpg not downloaded yet
2026-03-30 11:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F9b%252F569b3cecde27da1afa5d1a171d28c194%252Fpa%252FRN59979_98bb47b8ef39c24f89f2254a9e9e3ebc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_98bb47b8ef39c24f89f2254a9e9e3ebc.jpg not downloaded yet
2026-03-30 11:24:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BW58605> (referer: https://www.auto1.com/v1/car-details-view/BW58605/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd5c9dc0-220e-57cd-8810-a6578e489c44 with identifier: BW58605
2026-03-30 11:24:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd5c9dc0-220e-57cd-8810-a6578e489c44 with scrape type 1
2026-03-30 11:24:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd5c9dc0-220e-57cd-8810-a6578e489c44
2026-03-30 11:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fa8%252F13a89d6a2afd8e5f0689d446ce97152b%252Fpa%252FBW58605_1a79c3ed63589a927a11fb8e1973a7eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_1a79c3ed63589a927a11fb8e1973a7eb.jpg already downloaded
2026-03-30 11:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fa8%252F13a89d6a2afd8e5f0689d446ce97152b%252Fpa%252FBW58605_e640d5db32d163df71d308346bbe7cfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_e640d5db32d163df71d308346bbe7cfe.jpg already downloaded
2026-03-30 11:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fa8%252F13a89d6a2afd8e5f0689d446ce97152b%252Fpa%252FBW58605_e04b2f2ce610e18c57b2d366e8781e05.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_e04b2f2ce610e18c57b2d366e8781e05.jpg already downloaded
2026-03-30 11:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fa8%252F13a89d6a2afd8e5f0689d446ce97152b%252Fpa%252FBW58605_5dbbfd875e6333e35e3fb46f2f3c1709.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_5dbbfd875e6333e35e3fb46f2f3c1709.jpg already downloaded
2026-03-30 11:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fa8%252F13a89d6a2afd8e5f0689d446ce97152b%252Fpa%252FBW58605_d3969c883a4629c13eb0ea5da453be11.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_d3969c883a4629c13eb0ea5da453be11.jpg already downloaded
2026-03-30 11:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fa8%252F13a89d6a2afd8e5f0689d446ce97152b%252Fpa%252FBW58605_66a6a9197e3a4472fa0b0b22dafd212d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_66a6a9197e3a4472fa0b0b22dafd212d.jpg already downloaded
2026-03-30 11:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fa8%252F13a89d6a2afd8e5f0689d446ce97152b%252Fpa%252FBW58605_cda16b6ccc5241a670497cb4b5a4fd22.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_cda16b6ccc5241a670497cb4b5a4fd22.jpg already downloaded
2026-03-30 11:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fa8%252F13a89d6a2afd8e5f0689d446ce97152b%252Fpa%252FBW58605_36e38dd33aefa3e36989f448ad6aa58d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_36e38dd33aefa3e36989f448ad6aa58d.jpg already downloaded
2026-03-30 11:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fa8%252F13a89d6a2afd8e5f0689d446ce97152b%252Fpa%252FBW58605_c80d279bba60193ced2063fed8f6a6b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_c80d279bba60193ced2063fed8f6a6b6.jpg already downloaded
2026-03-30 11:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fa8%252F13a89d6a2afd8e5f0689d446ce97152b%252Fpa%252FBW58605_1d6bb479066880f05fdb4fed80c6d279.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_1d6bb479066880f05fdb4fed80c6d279.jpg already downloaded
2026-03-30 11:24:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fd5c9dc0-220e-57cd-8810-a6578e489c44, identifier: BW58605
2026-03-30 11:24:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fd5c9dc0-220e-57cd-8810-a6578e489c44 with identifier: BW58605
2026-03-30 11:24:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fd5c9dc0-220e-57cd-8810-a6578e489c44 with identifier: BW58605
2026-03-30 11:24:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fd5c9dc0-220e-57cd-8810-a6578e489c44 with identifier: BW58605 to the API
2026-03-30 11:24:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BW58605>
{'auction_title': '',
'c_o_2_emission_value': 189,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.7L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:45:48Z',
'fuel_type': 'diesel',
'id': 'fd5c9dc0-220e-57cd-8810-a6578e489c44',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW58605',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Audi',
'model': 'A6',
'odometer': 328176,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_1a79c3ed63589a927a11fb8e1973a7eb.jpg',
'https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_e640d5db32d163df71d308346bbe7cfe.jpg',
'https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_e04b2f2ce610e18c57b2d366e8781e05.jpg',
'https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_5dbbfd875e6333e35e3fb46f2f3c1709.jpg',
'https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_d3969c883a4629c13eb0ea5da453be11.jpg',
'https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_66a6a9197e3a4472fa0b0b22dafd212d.jpg',
'https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_cda16b6ccc5241a670497cb4b5a4fd22.jpg',
'https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_36e38dd33aefa3e36989f448ad6aa58d.jpg',
'https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_c80d279bba60193ced2063fed8f6a6b6.jpg',
'https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_1d6bb479066880f05fdb4fed80c6d279.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd5c9dc0-220e-57cd-8810-a6578e489c44/fd5c9dc0-220e-57cd-8810-a6578e489c44_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2570186,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_1a79c3ed63589a927a11fb8e1973a7eb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd5c9dc0-220e-57cd-8810-a6578e489c44/fd5c9dc0-220e-57cd-8810-a6578e489c44_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2416287,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_e640d5db32d163df71d308346bbe7cfe.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd5c9dc0-220e-57cd-8810-a6578e489c44/fd5c9dc0-220e-57cd-8810-a6578e489c44_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2463156,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_e04b2f2ce610e18c57b2d366e8781e05.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd5c9dc0-220e-57cd-8810-a6578e489c44/fd5c9dc0-220e-57cd-8810-a6578e489c44_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72562,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_5dbbfd875e6333e35e3fb46f2f3c1709.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd5c9dc0-220e-57cd-8810-a6578e489c44/fd5c9dc0-220e-57cd-8810-a6578e489c44_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92387,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_d3969c883a4629c13eb0ea5da453be11.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd5c9dc0-220e-57cd-8810-a6578e489c44/fd5c9dc0-220e-57cd-8810-a6578e489c44_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90049,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_66a6a9197e3a4472fa0b0b22dafd212d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd5c9dc0-220e-57cd-8810-a6578e489c44/fd5c9dc0-220e-57cd-8810-a6578e489c44_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2249918,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_cda16b6ccc5241a670497cb4b5a4fd22.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd5c9dc0-220e-57cd-8810-a6578e489c44/fd5c9dc0-220e-57cd-8810-a6578e489c44_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84407,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_36e38dd33aefa3e36989f448ad6aa58d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd5c9dc0-220e-57cd-8810-a6578e489c44/fd5c9dc0-220e-57cd-8810-a6578e489c44_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_c80d279bba60193ced2063fed8f6a6b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd5c9dc0-220e-57cd-8810-a6578e489c44/fd5c9dc0-220e-57cd-8810-a6578e489c44_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2499337,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img13/a8/13a89d6a2afd8e5f0689d446ce97152b/pa/BW58605_1d6bb479066880f05fdb4fed80c6d279.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-03-06',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 2.7 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2011}
2026-03-30 11:24:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BW58605%27 HTTP/1.1" 200 None
2026-03-30 11:24:52 [auto1.fr] INFO: Saving data for BW58605: {'created_time': 1774869892.915211, 'last_price_update_time': 1774869892.915222, 'auction_closing_time': 1774971948.0}
2026-03-30 11:24:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BW58605') HTTP/1.1" 204 0
2026-03-30 11:24:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_98bb47b8ef39c24f89f2254a9e9e3ebc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_7d76853def79a4ecf4626e9580a22e97.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_f57af2c027c761d7bc83045fde4b717b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385a8bd0>
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9ffc469-d2ba-590b-8c43-24db6ad38714/c9ffc469-d2ba-590b-8c43-24db6ad38714_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F9b%252F569b3cecde27da1afa5d1a171d28c194%252Fpa%252FRN59979_98bb47b8ef39c24f89f2254a9e9e3ebc.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_98bb47b8ef39c24f89f2254a9e9e3ebc.jpg saved to cache
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9ffc469-d2ba-590b-8c43-24db6ad38714
2026-03-30 11:24:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_9db9cae2080e1689c97df4bafbaf1abc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383bfe50>
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9ffc469-d2ba-590b-8c43-24db6ad38714/c9ffc469-d2ba-590b-8c43-24db6ad38714_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F9b%252F569b3cecde27da1afa5d1a171d28c194%252Fpa%252FRN59979_7d76853def79a4ecf4626e9580a22e97.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_7d76853def79a4ecf4626e9580a22e97.jpg saved to cache
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9ffc469-d2ba-590b-8c43-24db6ad38714
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738560fd0>
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9ffc469-d2ba-590b-8c43-24db6ad38714/c9ffc469-d2ba-590b-8c43-24db6ad38714_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F9b%252F569b3cecde27da1afa5d1a171d28c194%252Fpa%252FRN59979_f57af2c027c761d7bc83045fde4b717b.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_f57af2c027c761d7bc83045fde4b717b.jpg saved to cache
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9ffc469-d2ba-590b-8c43-24db6ad38714
2026-03-30 11:24:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_c51f3326a5a0a29d13139e63c384aa4e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738425b50>
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9ffc469-d2ba-590b-8c43-24db6ad38714/c9ffc469-d2ba-590b-8c43-24db6ad38714_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F9b%252F569b3cecde27da1afa5d1a171d28c194%252Fpa%252FRN59979_9db9cae2080e1689c97df4bafbaf1abc.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_9db9cae2080e1689c97df4bafbaf1abc.jpg saved to cache
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9ffc469-d2ba-590b-8c43-24db6ad38714
2026-03-30 11:24:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_96ab3f8e671f7672c83342ba9fcd0a29.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_e995ed0f65acabd621574bd489851cc5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383bd690>
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9ffc469-d2ba-590b-8c43-24db6ad38714/c9ffc469-d2ba-590b-8c43-24db6ad38714_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F9b%252F569b3cecde27da1afa5d1a171d28c194%252Fpa%252FRN59979_c51f3326a5a0a29d13139e63c384aa4e.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_c51f3326a5a0a29d13139e63c384aa4e.jpg saved to cache
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9ffc469-d2ba-590b-8c43-24db6ad38714
2026-03-30 11:24:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_96d99fe6d6f9e57dca626fa6ac20ce0d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383f4f10>
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9ffc469-d2ba-590b-8c43-24db6ad38714/c9ffc469-d2ba-590b-8c43-24db6ad38714_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F9b%252F569b3cecde27da1afa5d1a171d28c194%252Fpa%252FRN59979_96ab3f8e671f7672c83342ba9fcd0a29.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_96ab3f8e671f7672c83342ba9fcd0a29.jpg saved to cache
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9ffc469-d2ba-590b-8c43-24db6ad38714
2026-03-30 11:24:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_8260373db10347a01ade231e25b7f09c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383d39d0>
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9ffc469-d2ba-590b-8c43-24db6ad38714/c9ffc469-d2ba-590b-8c43-24db6ad38714_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F9b%252F569b3cecde27da1afa5d1a171d28c194%252Fpa%252FRN59979_e995ed0f65acabd621574bd489851cc5.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_e995ed0f65acabd621574bd489851cc5.jpg saved to cache
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9ffc469-d2ba-590b-8c43-24db6ad38714
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384be150>
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9ffc469-d2ba-590b-8c43-24db6ad38714/c9ffc469-d2ba-590b-8c43-24db6ad38714_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F9b%252F569b3cecde27da1afa5d1a171d28c194%252Fpa%252FRN59979_96d99fe6d6f9e57dca626fa6ac20ce0d.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_96d99fe6d6f9e57dca626fa6ac20ce0d.jpg saved to cache
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9ffc469-d2ba-590b-8c43-24db6ad38714
2026-03-30 11:24:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_37bf4382ea89fd3fe57ba83529fd501f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738562a10>
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9ffc469-d2ba-590b-8c43-24db6ad38714/c9ffc469-d2ba-590b-8c43-24db6ad38714_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F9b%252F569b3cecde27da1afa5d1a171d28c194%252Fpa%252FRN59979_8260373db10347a01ade231e25b7f09c.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_8260373db10347a01ade231e25b7f09c.jpg saved to cache
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9ffc469-d2ba-590b-8c43-24db6ad38714
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738467050>
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9ffc469-d2ba-590b-8c43-24db6ad38714/c9ffc469-d2ba-590b-8c43-24db6ad38714_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F9b%252F569b3cecde27da1afa5d1a171d28c194%252Fpa%252FRN59979_37bf4382ea89fd3fe57ba83529fd501f.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_37bf4382ea89fd3fe57ba83529fd501f.jpg saved to cache
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9ffc469-d2ba-590b-8c43-24db6ad38714
2026-03-30 11:24:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9ffc469-d2ba-590b-8c43-24db6ad38714, skipping ID generation
2026-03-30 11:24:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9ffc469-d2ba-590b-8c43-24db6ad38714 with scrape type 1
2026-03-30 11:24:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9ffc469-d2ba-590b-8c43-24db6ad38714 sending to next pipeline
2026-03-30 11:24:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c9ffc469-d2ba-590b-8c43-24db6ad38714, identifier: RN59979
2026-03-30 11:24:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c9ffc469-d2ba-590b-8c43-24db6ad38714 with identifier: RN59979
2026-03-30 11:24:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c9ffc469-d2ba-590b-8c43-24db6ad38714 with identifier: RN59979
2026-03-30 11:24:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c9ffc469-d2ba-590b-8c43-24db6ad38714 with identifier: RN59979 to the API
2026-03-30 11:24:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_37bf4382ea89fd3fe57ba83529fd501f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 244,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 212,
'expiration_date': '2026-03-31T15:00:12Z',
'fuel_type': 'diesel',
'id': 'c9ffc469-d2ba-590b-8c43-24db6ad38714',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN59979',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Ford',
'model': 'Ranger',
'odometer': 173358,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9ffc469-d2ba-590b-8c43-24db6ad38714/c9ffc469-d2ba-590b-8c43-24db6ad38714_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_37bf4382ea89fd3fe57ba83529fd501f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9ffc469-d2ba-590b-8c43-24db6ad38714/c9ffc469-d2ba-590b-8c43-24db6ad38714_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101592,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_8260373db10347a01ade231e25b7f09c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9ffc469-d2ba-590b-8c43-24db6ad38714/c9ffc469-d2ba-590b-8c43-24db6ad38714_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101999,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_96d99fe6d6f9e57dca626fa6ac20ce0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9ffc469-d2ba-590b-8c43-24db6ad38714/c9ffc469-d2ba-590b-8c43-24db6ad38714_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93144,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_e995ed0f65acabd621574bd489851cc5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9ffc469-d2ba-590b-8c43-24db6ad38714/c9ffc469-d2ba-590b-8c43-24db6ad38714_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93862,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_96ab3f8e671f7672c83342ba9fcd0a29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9ffc469-d2ba-590b-8c43-24db6ad38714/c9ffc469-d2ba-590b-8c43-24db6ad38714_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90759,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_c51f3326a5a0a29d13139e63c384aa4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9ffc469-d2ba-590b-8c43-24db6ad38714/c9ffc469-d2ba-590b-8c43-24db6ad38714_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90931,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_9db9cae2080e1689c97df4bafbaf1abc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9ffc469-d2ba-590b-8c43-24db6ad38714/c9ffc469-d2ba-590b-8c43-24db6ad38714_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_f57af2c027c761d7bc83045fde4b717b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9ffc469-d2ba-590b-8c43-24db6ad38714/c9ffc469-d2ba-590b-8c43-24db6ad38714_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110414,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_7d76853def79a4ecf4626e9580a22e97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9ffc469-d2ba-590b-8c43-24db6ad38714/c9ffc469-d2ba-590b-8c43-24db6ad38714_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76951,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/9b/569b3cecde27da1afa5d1a171d28c194/pa/RN59979_98bb47b8ef39c24f89f2254a9e9e3ebc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-15',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
'transmission': 'automatic',
'trim': 'Doppelkabine 4x4 Wildtrak',
'year': 2020}
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN59979%27 HTTP/1.1" 200 None
2026-03-30 11:24:54 [auto1.fr] INFO: Saving data for RN59979: {'created_time': 1774869894.284184, 'last_price_update_time': 1774869894.284195, 'auction_closing_time': 1774969212.0}
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RN59979') HTTP/1.1" 204 0
2026-03-30 11:24:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UE64879> (referer: https://www.auto1.com/v1/car-details-view/UE64879/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d10450e-887f-544d-89ad-d5e90e3749e0 with identifier: UE64879
2026-03-30 11:24:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d10450e-887f-544d-89ad-d5e90e3749e0 with scrape type 1
2026-03-30 11:24:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d10450e-887f-544d-89ad-d5e90e3749e0
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F10%252Fa11042874bccca34e4436d6fc1cceb32%252Fpa%252FUE64879_c8bf79c89302dc6c432714b62fe6ad53.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_c8bf79c89302dc6c432714b62fe6ad53.jpg not downloaded yet
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F10%252Fa11042874bccca34e4436d6fc1cceb32%252Fpa%252FUE64879_bece1b81095db2440b95503769952edd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_bece1b81095db2440b95503769952edd.jpg not downloaded yet
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F10%252Fa11042874bccca34e4436d6fc1cceb32%252Fpa%252FUE64879_c275a12e60c0901b63247d99ebfc06fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_c275a12e60c0901b63247d99ebfc06fd.jpg not downloaded yet
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F10%252Fa11042874bccca34e4436d6fc1cceb32%252Fpa%252FUE64879_e1629b08799a78829adad4ed98bed198.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_e1629b08799a78829adad4ed98bed198.jpg not downloaded yet
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F10%252Fa11042874bccca34e4436d6fc1cceb32%252Fpa%252FUE64879_cbe8ffe2939d5810796ab9429fa9c8f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_cbe8ffe2939d5810796ab9429fa9c8f7.jpg not downloaded yet
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F10%252Fa11042874bccca34e4436d6fc1cceb32%252Fpa%252FUE64879_d4043ae7b886a48ed6d2186b40b56e9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_d4043ae7b886a48ed6d2186b40b56e9f.jpg not downloaded yet
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F10%252Fa11042874bccca34e4436d6fc1cceb32%252Fpa%252FUE64879_22403e0a1038f1230437409518dfceb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_22403e0a1038f1230437409518dfceb2.jpg not downloaded yet
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F10%252Fa11042874bccca34e4436d6fc1cceb32%252Fpa%252FUE64879_068c4a2dce95a6688227b5e19c59991b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_068c4a2dce95a6688227b5e19c59991b.jpg not downloaded yet
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F10%252Fa11042874bccca34e4436d6fc1cceb32%252Fpa%252FUE64879_599c9a5cb0c314f586f278decbd021df.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_599c9a5cb0c314f586f278decbd021df.jpg not downloaded yet
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F10%252Fa11042874bccca34e4436d6fc1cceb32%252Fpa%252FUE64879_abd243ab19f08df30db3c88b451a05b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_abd243ab19f08df30db3c88b451a05b6.jpg not downloaded yet
2026-03-30 11:24:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZW51272/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_abd243ab19f08df30db3c88b451a05b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a7eb890>
2026-03-30 11:24:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d10450e-887f-544d-89ad-d5e90e3749e0/7d10450e-887f-544d-89ad-d5e90e3749e0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F10%252Fa11042874bccca34e4436d6fc1cceb32%252Fpa%252FUE64879_abd243ab19f08df30db3c88b451a05b6.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_abd243ab19f08df30db3c88b451a05b6.jpg saved to cache
2026-03-30 11:24:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d10450e-887f-544d-89ad-d5e90e3749e0
2026-03-30 11:24:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_599c9a5cb0c314f586f278decbd021df.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN76101> (referer: https://www.auto1.com/v1/car-details-view/ZN76101/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383d1690>
2026-03-30 11:24:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d10450e-887f-544d-89ad-d5e90e3749e0/7d10450e-887f-544d-89ad-d5e90e3749e0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F10%252Fa11042874bccca34e4436d6fc1cceb32%252Fpa%252FUE64879_599c9a5cb0c314f586f278decbd021df.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_599c9a5cb0c314f586f278decbd021df.jpg saved to cache
2026-03-30 11:24:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d10450e-887f-544d-89ad-d5e90e3749e0
2026-03-30 11:24:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63fb926b-c8f0-569d-a9b1-2f7fb80fa82b with identifier: ZN76101
2026-03-30 11:24:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63fb926b-c8f0-569d-a9b1-2f7fb80fa82b with scrape type 1
2026-03-30 11:24:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63fb926b-c8f0-569d-a9b1-2f7fb80fa82b
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F34%252F2e349f99a7a3101be867a33adc10c9f3%252Fpa%252FZN76101_2cba3739c0ed9b0df199a42bb95281c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_2cba3739c0ed9b0df199a42bb95281c6.jpg not downloaded yet
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F34%252F2e349f99a7a3101be867a33adc10c9f3%252Fpa%252FZN76101_1375e87c7a47fc47c0762eb317df8e54.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_1375e87c7a47fc47c0762eb317df8e54.jpg not downloaded yet
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F34%252F2e349f99a7a3101be867a33adc10c9f3%252Fpa%252FZN76101_54edc1c88acfa7d8f9b2b695e9df3272.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_54edc1c88acfa7d8f9b2b695e9df3272.jpg not downloaded yet
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F34%252F2e349f99a7a3101be867a33adc10c9f3%252Fpa%252FZN76101_388624551884a88214c7c63df610a475.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_388624551884a88214c7c63df610a475.jpg not downloaded yet
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F34%252F2e349f99a7a3101be867a33adc10c9f3%252Fpa%252FZN76101_73eb2e294c1be66f08504092da694bbe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_73eb2e294c1be66f08504092da694bbe.jpg not downloaded yet
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F34%252F2e349f99a7a3101be867a33adc10c9f3%252Fpa%252FZN76101_d0b6c25a998150db033345eef416a879.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_d0b6c25a998150db033345eef416a879.jpg not downloaded yet
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F34%252F2e349f99a7a3101be867a33adc10c9f3%252Fpa%252FZN76101_13a4af18f44d0af130b2e9e3b0688835.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_13a4af18f44d0af130b2e9e3b0688835.jpg not downloaded yet
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F34%252F2e349f99a7a3101be867a33adc10c9f3%252Fpa%252FZN76101_af170eadd864d8f652e2594281025782.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_af170eadd864d8f652e2594281025782.jpg not downloaded yet
2026-03-30 11:24:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_068c4a2dce95a6688227b5e19c59991b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F34%252F2e349f99a7a3101be867a33adc10c9f3%252Fpa%252FZN76101_4ea4f5f9a2dc774b55e4e49f135350ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_4ea4f5f9a2dc774b55e4e49f135350ab.jpg not downloaded yet
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F34%252F2e349f99a7a3101be867a33adc10c9f3%252Fpa%252FZN76101_e6896232cc87a36fc95894876ad160d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_e6896232cc87a36fc95894876ad160d7.jpg not downloaded yet
2026-03-30 11:24:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385ed0d0>
2026-03-30 11:24:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d10450e-887f-544d-89ad-d5e90e3749e0/7d10450e-887f-544d-89ad-d5e90e3749e0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F10%252Fa11042874bccca34e4436d6fc1cceb32%252Fpa%252FUE64879_068c4a2dce95a6688227b5e19c59991b.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_068c4a2dce95a6688227b5e19c59991b.jpg saved to cache
2026-03-30 11:24:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d10450e-887f-544d-89ad-d5e90e3749e0
2026-03-30 11:24:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_af170eadd864d8f652e2594281025782.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738432290>
2026-03-30 11:24:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fb926b-c8f0-569d-a9b1-2f7fb80fa82b/63fb926b-c8f0-569d-a9b1-2f7fb80fa82b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F34%252F2e349f99a7a3101be867a33adc10c9f3%252Fpa%252FZN76101_af170eadd864d8f652e2594281025782.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_af170eadd864d8f652e2594281025782.jpg saved to cache
2026-03-30 11:24:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63fb926b-c8f0-569d-a9b1-2f7fb80fa82b
2026-03-30 11:24:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL28829> (referer: https://www.auto1.com/v1/car-details-view/NL28829/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_e6896232cc87a36fc95894876ad160d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a28d0aa7-0b41-5a03-9661-0df037957c12 with identifier: NL28829
2026-03-30 11:24:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a28d0aa7-0b41-5a03-9661-0df037957c12 with scrape type 1
2026-03-30 11:24:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a28d0aa7-0b41-5a03-9661-0df037957c12
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F99%252F5d99c1200dfe9a3ce4ca6f96a2b6c8f8%252Fpa%252FNL28829_8760f8b469c5c04b405d1c10f46d1039.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_8760f8b469c5c04b405d1c10f46d1039.jpg already downloaded
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F99%252F5d99c1200dfe9a3ce4ca6f96a2b6c8f8%252Fpa%252FNL28829_6c19ee216a67122ae1680ddff0d31dc6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_6c19ee216a67122ae1680ddff0d31dc6.jpg already downloaded
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F99%252F5d99c1200dfe9a3ce4ca6f96a2b6c8f8%252Fpa%252FNL28829_633ea7620347363096b58d3dff94414a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_633ea7620347363096b58d3dff94414a.jpg already downloaded
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F99%252F5d99c1200dfe9a3ce4ca6f96a2b6c8f8%252Fpa%252FNL28829_87e564d1210aee90938f8d1ed4f59133.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_87e564d1210aee90938f8d1ed4f59133.jpg already downloaded
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F99%252F5d99c1200dfe9a3ce4ca6f96a2b6c8f8%252Fpa%252FNL28829_494459941272e976405980c8ab4a2d96.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_494459941272e976405980c8ab4a2d96.jpg already downloaded
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F99%252F5d99c1200dfe9a3ce4ca6f96a2b6c8f8%252Fpa%252FNL28829_60f2a9921bcffeeb438218b41b372344.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_60f2a9921bcffeeb438218b41b372344.jpg already downloaded
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F99%252F5d99c1200dfe9a3ce4ca6f96a2b6c8f8%252Fpa%252FNL28829_dff0a35964648b63925ca63f9df4762f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_dff0a35964648b63925ca63f9df4762f.jpg already downloaded
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F99%252F5d99c1200dfe9a3ce4ca6f96a2b6c8f8%252Fpa%252FNL28829_f17eb390bb056f22a9d2cb27a1f14cf0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_f17eb390bb056f22a9d2cb27a1f14cf0.jpg already downloaded
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F99%252F5d99c1200dfe9a3ce4ca6f96a2b6c8f8%252Fpa%252FNL28829_ee725be3699573af914679dddf288670.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_ee725be3699573af914679dddf288670.jpg already downloaded
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F99%252F5d99c1200dfe9a3ce4ca6f96a2b6c8f8%252Fpa%252FNL28829_e186f41cf5b506c4c0d8fcf7cc27b487.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_e186f41cf5b506c4c0d8fcf7cc27b487.jpg already downloaded
2026-03-30 11:24:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a28d0aa7-0b41-5a03-9661-0df037957c12, identifier: NL28829
2026-03-30 11:24:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a28d0aa7-0b41-5a03-9661-0df037957c12 with identifier: NL28829
2026-03-30 11:24:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a28d0aa7-0b41-5a03-9661-0df037957c12 with identifier: NL28829
2026-03-30 11:24:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a28d0aa7-0b41-5a03-9661-0df037957c12 with identifier: NL28829 to the API
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NL28829>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:38:59Z',
'fuel_type': 'petrol',
'id': 'a28d0aa7-0b41-5a03-9661-0df037957c12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL28829',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Citroen',
'model': 'DS3',
'odometer': 105013,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_8760f8b469c5c04b405d1c10f46d1039.jpg',
'https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_6c19ee216a67122ae1680ddff0d31dc6.jpg',
'https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_633ea7620347363096b58d3dff94414a.jpg',
'https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_87e564d1210aee90938f8d1ed4f59133.jpg',
'https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_494459941272e976405980c8ab4a2d96.jpg',
'https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_60f2a9921bcffeeb438218b41b372344.jpg',
'https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_dff0a35964648b63925ca63f9df4762f.jpg',
'https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_f17eb390bb056f22a9d2cb27a1f14cf0.jpg',
'https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_ee725be3699573af914679dddf288670.jpg',
'https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_e186f41cf5b506c4c0d8fcf7cc27b487.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28d0aa7-0b41-5a03-9661-0df037957c12/a28d0aa7-0b41-5a03-9661-0df037957c12_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_8760f8b469c5c04b405d1c10f46d1039.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28d0aa7-0b41-5a03-9661-0df037957c12/a28d0aa7-0b41-5a03-9661-0df037957c12_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79219,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_6c19ee216a67122ae1680ddff0d31dc6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28d0aa7-0b41-5a03-9661-0df037957c12/a28d0aa7-0b41-5a03-9661-0df037957c12_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76610,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_633ea7620347363096b58d3dff94414a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28d0aa7-0b41-5a03-9661-0df037957c12/a28d0aa7-0b41-5a03-9661-0df037957c12_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65611,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_87e564d1210aee90938f8d1ed4f59133.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28d0aa7-0b41-5a03-9661-0df037957c12/a28d0aa7-0b41-5a03-9661-0df037957c12_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70409,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_494459941272e976405980c8ab4a2d96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28d0aa7-0b41-5a03-9661-0df037957c12/a28d0aa7-0b41-5a03-9661-0df037957c12_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72441,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_60f2a9921bcffeeb438218b41b372344.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28d0aa7-0b41-5a03-9661-0df037957c12/a28d0aa7-0b41-5a03-9661-0df037957c12_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_dff0a35964648b63925ca63f9df4762f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28d0aa7-0b41-5a03-9661-0df037957c12/a28d0aa7-0b41-5a03-9661-0df037957c12_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70922,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_f17eb390bb056f22a9d2cb27a1f14cf0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28d0aa7-0b41-5a03-9661-0df037957c12/a28d0aa7-0b41-5a03-9661-0df037957c12_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_ee725be3699573af914679dddf288670.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28d0aa7-0b41-5a03-9661-0df037957c12/a28d0aa7-0b41-5a03-9661-0df037957c12_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72340,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/99/5d99c1200dfe9a3ce4ca6f96a2b6c8f8/pa/NL28829_e186f41cf5b506c4c0d8fcf7cc27b487.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-06-26',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen DS3 1.4 VTi Chic',
'transmission': 'manual',
'trim': 'Chic',
'year': 2012}
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL28829%27 HTTP/1.1" 200 None
2026-03-30 11:24:57 [auto1.fr] INFO: Saving data for NL28829: {'created_time': 1774869897.971733, 'last_price_update_time': 1774869897.971744, 'auction_closing_time': 1774971539.0}
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NL28829') HTTP/1.1" 204 0
2026-03-30 11:24:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_13a4af18f44d0af130b2e9e3b0688835.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383a8b50>
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fb926b-c8f0-569d-a9b1-2f7fb80fa82b/63fb926b-c8f0-569d-a9b1-2f7fb80fa82b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F34%252F2e349f99a7a3101be867a33adc10c9f3%252Fpa%252FZN76101_e6896232cc87a36fc95894876ad160d7.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_e6896232cc87a36fc95894876ad160d7.jpg saved to cache
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63fb926b-c8f0-569d-a9b1-2f7fb80fa82b
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383d0350>
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fb926b-c8f0-569d-a9b1-2f7fb80fa82b/63fb926b-c8f0-569d-a9b1-2f7fb80fa82b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F34%252F2e349f99a7a3101be867a33adc10c9f3%252Fpa%252FZN76101_13a4af18f44d0af130b2e9e3b0688835.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_13a4af18f44d0af130b2e9e3b0688835.jpg saved to cache
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63fb926b-c8f0-569d-a9b1-2f7fb80fa82b
2026-03-30 11:24:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_4ea4f5f9a2dc774b55e4e49f135350ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_d0b6c25a998150db033345eef416a879.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384bffd0>
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fb926b-c8f0-569d-a9b1-2f7fb80fa82b/63fb926b-c8f0-569d-a9b1-2f7fb80fa82b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F34%252F2e349f99a7a3101be867a33adc10c9f3%252Fpa%252FZN76101_4ea4f5f9a2dc774b55e4e49f135350ab.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_4ea4f5f9a2dc774b55e4e49f135350ab.jpg saved to cache
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 63fb926b-c8f0-569d-a9b1-2f7fb80fa82b
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738466690>
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fb926b-c8f0-569d-a9b1-2f7fb80fa82b/63fb926b-c8f0-569d-a9b1-2f7fb80fa82b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F34%252F2e349f99a7a3101be867a33adc10c9f3%252Fpa%252FZN76101_d0b6c25a998150db033345eef416a879.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_d0b6c25a998150db033345eef416a879.jpg saved to cache
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63fb926b-c8f0-569d-a9b1-2f7fb80fa82b
2026-03-30 11:24:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX65836/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_73eb2e294c1be66f08504092da694bbe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_388624551884a88214c7c63df610a475.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_2cba3739c0ed9b0df199a42bb95281c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_1375e87c7a47fc47c0762eb317df8e54.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_22403e0a1038f1230437409518dfceb2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385aab50>
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fb926b-c8f0-569d-a9b1-2f7fb80fa82b/63fb926b-c8f0-569d-a9b1-2f7fb80fa82b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F34%252F2e349f99a7a3101be867a33adc10c9f3%252Fpa%252FZN76101_73eb2e294c1be66f08504092da694bbe.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_73eb2e294c1be66f08504092da694bbe.jpg saved to cache
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63fb926b-c8f0-569d-a9b1-2f7fb80fa82b
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073849f710>
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fb926b-c8f0-569d-a9b1-2f7fb80fa82b/63fb926b-c8f0-569d-a9b1-2f7fb80fa82b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F34%252F2e349f99a7a3101be867a33adc10c9f3%252Fpa%252FZN76101_388624551884a88214c7c63df610a475.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_388624551884a88214c7c63df610a475.jpg saved to cache
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63fb926b-c8f0-569d-a9b1-2f7fb80fa82b
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738428b50>
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fb926b-c8f0-569d-a9b1-2f7fb80fa82b/63fb926b-c8f0-569d-a9b1-2f7fb80fa82b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F34%252F2e349f99a7a3101be867a33adc10c9f3%252Fpa%252FZN76101_2cba3739c0ed9b0df199a42bb95281c6.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_2cba3739c0ed9b0df199a42bb95281c6.jpg saved to cache
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63fb926b-c8f0-569d-a9b1-2f7fb80fa82b
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738447450>
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fb926b-c8f0-569d-a9b1-2f7fb80fa82b/63fb926b-c8f0-569d-a9b1-2f7fb80fa82b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F34%252F2e349f99a7a3101be867a33adc10c9f3%252Fpa%252FZN76101_1375e87c7a47fc47c0762eb317df8e54.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_1375e87c7a47fc47c0762eb317df8e54.jpg saved to cache
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63fb926b-c8f0-569d-a9b1-2f7fb80fa82b
2026-03-30 11:24:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_54edc1c88acfa7d8f9b2b695e9df3272.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a534190>
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d10450e-887f-544d-89ad-d5e90e3749e0/7d10450e-887f-544d-89ad-d5e90e3749e0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F10%252Fa11042874bccca34e4436d6fc1cceb32%252Fpa%252FUE64879_22403e0a1038f1230437409518dfceb2.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_22403e0a1038f1230437409518dfceb2.jpg saved to cache
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d10450e-887f-544d-89ad-d5e90e3749e0
2026-03-30 11:24:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_d4043ae7b886a48ed6d2186b40b56e9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738424510>
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fb926b-c8f0-569d-a9b1-2f7fb80fa82b/63fb926b-c8f0-569d-a9b1-2f7fb80fa82b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F34%252F2e349f99a7a3101be867a33adc10c9f3%252Fpa%252FZN76101_54edc1c88acfa7d8f9b2b695e9df3272.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_54edc1c88acfa7d8f9b2b695e9df3272.jpg saved to cache
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63fb926b-c8f0-569d-a9b1-2f7fb80fa82b
2026-03-30 11:24:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63fb926b-c8f0-569d-a9b1-2f7fb80fa82b, skipping ID generation
2026-03-30 11:24:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63fb926b-c8f0-569d-a9b1-2f7fb80fa82b with scrape type 1
2026-03-30 11:24:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63fb926b-c8f0-569d-a9b1-2f7fb80fa82b sending to next pipeline
2026-03-30 11:24:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 63fb926b-c8f0-569d-a9b1-2f7fb80fa82b, identifier: ZN76101
2026-03-30 11:24:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 63fb926b-c8f0-569d-a9b1-2f7fb80fa82b with identifier: ZN76101
2026-03-30 11:24:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 63fb926b-c8f0-569d-a9b1-2f7fb80fa82b with identifier: ZN76101
2026-03-30 11:24:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 63fb926b-c8f0-569d-a9b1-2f7fb80fa82b with identifier: ZN76101 to the API
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_54edc1c88acfa7d8f9b2b695e9df3272.jpg>
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:05:21Z',
'fuel_type': 'diesel',
'id': '63fb926b-c8f0-569d-a9b1-2f7fb80fa82b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN76101',
'listing': 'auction',
'location': 'FR',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 208067,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fb926b-c8f0-569d-a9b1-2f7fb80fa82b/63fb926b-c8f0-569d-a9b1-2f7fb80fa82b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78002,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_2cba3739c0ed9b0df199a42bb95281c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fb926b-c8f0-569d-a9b1-2f7fb80fa82b/63fb926b-c8f0-569d-a9b1-2f7fb80fa82b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_1375e87c7a47fc47c0762eb317df8e54.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fb926b-c8f0-569d-a9b1-2f7fb80fa82b/63fb926b-c8f0-569d-a9b1-2f7fb80fa82b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78286,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_54edc1c88acfa7d8f9b2b695e9df3272.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fb926b-c8f0-569d-a9b1-2f7fb80fa82b/63fb926b-c8f0-569d-a9b1-2f7fb80fa82b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_388624551884a88214c7c63df610a475.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fb926b-c8f0-569d-a9b1-2f7fb80fa82b/63fb926b-c8f0-569d-a9b1-2f7fb80fa82b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76745,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_73eb2e294c1be66f08504092da694bbe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fb926b-c8f0-569d-a9b1-2f7fb80fa82b/63fb926b-c8f0-569d-a9b1-2f7fb80fa82b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_d0b6c25a998150db033345eef416a879.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fb926b-c8f0-569d-a9b1-2f7fb80fa82b/63fb926b-c8f0-569d-a9b1-2f7fb80fa82b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_13a4af18f44d0af130b2e9e3b0688835.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fb926b-c8f0-569d-a9b1-2f7fb80fa82b/63fb926b-c8f0-569d-a9b1-2f7fb80fa82b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87616,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_af170eadd864d8f652e2594281025782.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fb926b-c8f0-569d-a9b1-2f7fb80fa82b/63fb926b-c8f0-569d-a9b1-2f7fb80fa82b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86324,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_4ea4f5f9a2dc774b55e4e49f135350ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fb926b-c8f0-569d-a9b1-2f7fb80fa82b/63fb926b-c8f0-569d-a9b1-2f7fb80fa82b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83613,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/34/2e349f99a7a3101be867a33adc10c9f3/pa/ZN76101_e6896232cc87a36fc95894876ad160d7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-01-28',
'seats_number': 7,
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 HDi Ambiance',
'transmission': 'manual',
'trim': 'Ambiance',
'year': 2009}
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN76101%27 HTTP/1.1" 200 None
2026-03-30 11:24:59 [auto1.fr] INFO: Saving data for ZN76101: {'created_time': 1774869899.362892, 'last_price_update_time': 1774869899.362903, 'auction_closing_time': 1774969521.0}
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZN76101') HTTP/1.1" 204 0
2026-03-30 11:24:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_cbe8ffe2939d5810796ab9429fa9c8f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_e1629b08799a78829adad4ed98bed198.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738706f50>
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d10450e-887f-544d-89ad-d5e90e3749e0/7d10450e-887f-544d-89ad-d5e90e3749e0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F10%252Fa11042874bccca34e4436d6fc1cceb32%252Fpa%252FUE64879_d4043ae7b886a48ed6d2186b40b56e9f.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_d4043ae7b886a48ed6d2186b40b56e9f.jpg saved to cache
2026-03-30 11:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d10450e-887f-544d-89ad-d5e90e3749e0
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385aa510>
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d10450e-887f-544d-89ad-d5e90e3749e0/7d10450e-887f-544d-89ad-d5e90e3749e0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F10%252Fa11042874bccca34e4436d6fc1cceb32%252Fpa%252FUE64879_cbe8ffe2939d5810796ab9429fa9c8f7.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_cbe8ffe2939d5810796ab9429fa9c8f7.jpg saved to cache
2026-03-30 11:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d10450e-887f-544d-89ad-d5e90e3749e0
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073853f210>
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d10450e-887f-544d-89ad-d5e90e3749e0/7d10450e-887f-544d-89ad-d5e90e3749e0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F10%252Fa11042874bccca34e4436d6fc1cceb32%252Fpa%252FUE64879_e1629b08799a78829adad4ed98bed198.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_e1629b08799a78829adad4ed98bed198.jpg saved to cache
2026-03-30 11:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d10450e-887f-544d-89ad-d5e90e3749e0
2026-03-30 11:24:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_bece1b81095db2440b95503769952edd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_c275a12e60c0901b63247d99ebfc06fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_c8bf79c89302dc6c432714b62fe6ad53.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385543d0>
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d10450e-887f-544d-89ad-d5e90e3749e0/7d10450e-887f-544d-89ad-d5e90e3749e0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F10%252Fa11042874bccca34e4436d6fc1cceb32%252Fpa%252FUE64879_bece1b81095db2440b95503769952edd.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_bece1b81095db2440b95503769952edd.jpg saved to cache
2026-03-30 11:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d10450e-887f-544d-89ad-d5e90e3749e0
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384be5d0>
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d10450e-887f-544d-89ad-d5e90e3749e0/7d10450e-887f-544d-89ad-d5e90e3749e0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F10%252Fa11042874bccca34e4436d6fc1cceb32%252Fpa%252FUE64879_c275a12e60c0901b63247d99ebfc06fd.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_c275a12e60c0901b63247d99ebfc06fd.jpg saved to cache
2026-03-30 11:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d10450e-887f-544d-89ad-d5e90e3749e0
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383bc350>
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d10450e-887f-544d-89ad-d5e90e3749e0/7d10450e-887f-544d-89ad-d5e90e3749e0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F10%252Fa11042874bccca34e4436d6fc1cceb32%252Fpa%252FUE64879_c8bf79c89302dc6c432714b62fe6ad53.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_c8bf79c89302dc6c432714b62fe6ad53.jpg saved to cache
2026-03-30 11:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d10450e-887f-544d-89ad-d5e90e3749e0
2026-03-30 11:24:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d10450e-887f-544d-89ad-d5e90e3749e0, skipping ID generation
2026-03-30 11:24:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d10450e-887f-544d-89ad-d5e90e3749e0 with scrape type 1
2026-03-30 11:24:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d10450e-887f-544d-89ad-d5e90e3749e0 sending to next pipeline
2026-03-30 11:24:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7d10450e-887f-544d-89ad-d5e90e3749e0, identifier: UE64879
2026-03-30 11:24:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7d10450e-887f-544d-89ad-d5e90e3749e0 with identifier: UE64879
2026-03-30 11:24:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7d10450e-887f-544d-89ad-d5e90e3749e0 with identifier: UE64879
2026-03-30 11:24:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7d10450e-887f-544d-89ad-d5e90e3749e0 with identifier: UE64879 to the API
2026-03-30 11:24:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_c8bf79c89302dc6c432714b62fe6ad53.jpg>
{'auction_title': '',
'c_o_2_emission_value': 32,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 224,
'expiration_date': '2026-03-31T15:12:08Z',
'fuel_type': 'hybrid',
'id': '7d10450e-887f-544d-89ad-d5e90e3749e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE64879',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Citroen',
'model': 'C5 Aircross',
'odometer': 85699,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d10450e-887f-544d-89ad-d5e90e3749e0/7d10450e-887f-544d-89ad-d5e90e3749e0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_c8bf79c89302dc6c432714b62fe6ad53.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d10450e-887f-544d-89ad-d5e90e3749e0/7d10450e-887f-544d-89ad-d5e90e3749e0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_bece1b81095db2440b95503769952edd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d10450e-887f-544d-89ad-d5e90e3749e0/7d10450e-887f-544d-89ad-d5e90e3749e0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85179,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_c275a12e60c0901b63247d99ebfc06fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d10450e-887f-544d-89ad-d5e90e3749e0/7d10450e-887f-544d-89ad-d5e90e3749e0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91408,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_e1629b08799a78829adad4ed98bed198.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d10450e-887f-544d-89ad-d5e90e3749e0/7d10450e-887f-544d-89ad-d5e90e3749e0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104164,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_cbe8ffe2939d5810796ab9429fa9c8f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d10450e-887f-544d-89ad-d5e90e3749e0/7d10450e-887f-544d-89ad-d5e90e3749e0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_d4043ae7b886a48ed6d2186b40b56e9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d10450e-887f-544d-89ad-d5e90e3749e0/7d10450e-887f-544d-89ad-d5e90e3749e0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99355,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_22403e0a1038f1230437409518dfceb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d10450e-887f-544d-89ad-d5e90e3749e0/7d10450e-887f-544d-89ad-d5e90e3749e0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114505,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_068c4a2dce95a6688227b5e19c59991b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d10450e-887f-544d-89ad-d5e90e3749e0/7d10450e-887f-544d-89ad-d5e90e3749e0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88311,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_599c9a5cb0c314f586f278decbd021df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d10450e-887f-544d-89ad-d5e90e3749e0/7d10450e-887f-544d-89ad-d5e90e3749e0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65518,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/10/a11042874bccca34e4436d6fc1cceb32/pa/UE64879_abd243ab19f08df30db3c88b451a05b6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-25',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C5 Aircross 1.6 Plug-in Hybrid ë-EAT8 Shine Pack',
'transmission': 'automatic',
'trim': 'Shine Pack',
'year': 2020}
2026-03-30 11:25:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UE64879%27 HTTP/1.1" 200 None
2026-03-30 11:25:00 [auto1.fr] INFO: Saving data for UE64879: {'created_time': 1774869900.373003, 'last_price_update_time': 1774869900.373017, 'auction_closing_time': 1774969928.0}
2026-03-30 11:25:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UE64879') HTTP/1.1" 204 0
2026-03-30 11:25:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL06097/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX64079> (referer: https://www.auto1.com/v1/car-details-view/RX64079/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c91c8c1-6451-5fd7-942b-1ca797abe238 with identifier: RX64079
2026-03-30 11:25:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c91c8c1-6451-5fd7-942b-1ca797abe238 with scrape type 1
2026-03-30 11:25:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 6c91c8c1-6451-5fd7-942b-1ca797abe238
2026-03-30 11:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffa%252F64fad26b285d4159a0b68ea71b51d6f5%252Fpa%252FRX64079_22f79d2c7ddf3be780420f8a82bfe256.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fa/64fad26b285d4159a0b68ea71b51d6f5/pa/RX64079_22f79d2c7ddf3be780420f8a82bfe256.jpg already downloaded
2026-03-30 11:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffa%252F64fad26b285d4159a0b68ea71b51d6f5%252Fpa%252FRX64079_f71d4ca2676784c542ca8a0570a2264f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fa/64fad26b285d4159a0b68ea71b51d6f5/pa/RX64079_f71d4ca2676784c542ca8a0570a2264f.jpg already downloaded
2026-03-30 11:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffa%252F64fad26b285d4159a0b68ea71b51d6f5%252Fpa%252FRX64079_67c58e8e3375d5471a40b886e19f9925.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fa/64fad26b285d4159a0b68ea71b51d6f5/pa/RX64079_67c58e8e3375d5471a40b886e19f9925.jpg already downloaded
2026-03-30 11:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffa%252F64fad26b285d4159a0b68ea71b51d6f5%252Fpa%252FRX64079_724a82abb7d22335a7d6ede4359f5905.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fa/64fad26b285d4159a0b68ea71b51d6f5/pa/RX64079_724a82abb7d22335a7d6ede4359f5905.jpg already downloaded
2026-03-30 11:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffa%252F64fad26b285d4159a0b68ea71b51d6f5%252Fpa%252FRX64079_b08f264da8d6fed032dceaeb1a7b929d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fa/64fad26b285d4159a0b68ea71b51d6f5/pa/RX64079_b08f264da8d6fed032dceaeb1a7b929d.jpg already downloaded
2026-03-30 11:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Ffa%252F64fad26b285d4159a0b68ea71b51d6f5%252Fpa%252FRX64079_7c32025ca5195b75bec9182f296f160a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/fa/64fad26b285d4159a0b68ea71b51d6f5/pa/RX64079_7c32025ca5195b75bec9182f296f160a.jpg already downloaded
2026-03-30 11:25:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6c91c8c1-6451-5fd7-942b-1ca797abe238, identifier: RX64079
2026-03-30 11:25:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6c91c8c1-6451-5fd7-942b-1ca797abe238 with identifier: RX64079
2026-03-30 11:25:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6c91c8c1-6451-5fd7-942b-1ca797abe238 with identifier: RX64079
2026-03-30 11:25:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6c91c8c1-6451-5fd7-942b-1ca797abe238 with identifier: RX64079 to the API
2026-03-30 11:25:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RX64079>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:23:22Z',
'fuel_type': 'petrol',
'id': '6c91c8c1-6451-5fd7-942b-1ca797abe238',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX64079',
'listing': 'auction',
'location': 'FR, Houecourt',
'make': 'Peugeot',
'model': '208',
'odometer': 108447,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img64/fa/64fad26b285d4159a0b68ea71b51d6f5/pa/RX64079_22f79d2c7ddf3be780420f8a82bfe256.jpg',
'https://img-pa.auto1.com/img64/fa/64fad26b285d4159a0b68ea71b51d6f5/pa/RX64079_f71d4ca2676784c542ca8a0570a2264f.jpg',
'https://img-pa.auto1.com/img64/fa/64fad26b285d4159a0b68ea71b51d6f5/pa/RX64079_67c58e8e3375d5471a40b886e19f9925.jpg',
'https://img-pa.auto1.com/img64/fa/64fad26b285d4159a0b68ea71b51d6f5/pa/RX64079_724a82abb7d22335a7d6ede4359f5905.jpg',
'https://img-pa.auto1.com/img64/fa/64fad26b285d4159a0b68ea71b51d6f5/pa/RX64079_b08f264da8d6fed032dceaeb1a7b929d.jpg',
'https://img-pa.auto1.com/img64/fa/64fad26b285d4159a0b68ea71b51d6f5/pa/RX64079_7c32025ca5195b75bec9182f296f160a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c91c8c1-6451-5fd7-942b-1ca797abe238/6c91c8c1-6451-5fd7-942b-1ca797abe238_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68242,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/fa/64fad26b285d4159a0b68ea71b51d6f5/pa/RX64079_22f79d2c7ddf3be780420f8a82bfe256.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c91c8c1-6451-5fd7-942b-1ca797abe238/6c91c8c1-6451-5fd7-942b-1ca797abe238_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67829,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/fa/64fad26b285d4159a0b68ea71b51d6f5/pa/RX64079_f71d4ca2676784c542ca8a0570a2264f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c91c8c1-6451-5fd7-942b-1ca797abe238/6c91c8c1-6451-5fd7-942b-1ca797abe238_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55906,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/fa/64fad26b285d4159a0b68ea71b51d6f5/pa/RX64079_67c58e8e3375d5471a40b886e19f9925.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c91c8c1-6451-5fd7-942b-1ca797abe238/6c91c8c1-6451-5fd7-942b-1ca797abe238_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78939,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/fa/64fad26b285d4159a0b68ea71b51d6f5/pa/RX64079_724a82abb7d22335a7d6ede4359f5905.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c91c8c1-6451-5fd7-942b-1ca797abe238/6c91c8c1-6451-5fd7-942b-1ca797abe238_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/fa/64fad26b285d4159a0b68ea71b51d6f5/pa/RX64079_b08f264da8d6fed032dceaeb1a7b929d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c91c8c1-6451-5fd7-942b-1ca797abe238/6c91c8c1-6451-5fd7-942b-1ca797abe238_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38708,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/fa/64fad26b285d4159a0b68ea71b51d6f5/pa/RX64079_7c32025ca5195b75bec9182f296f160a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-20',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Like',
'transmission': 'manual',
'trim': 'Like',
'year': 2019}
2026-03-30 11:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX64079%27 HTTP/1.1" 200 None
2026-03-30 11:25:02 [auto1.fr] INFO: Saving data for RX64079: {'created_time': 1774869902.880194, 'last_price_update_time': 1774869902.880204, 'auction_closing_time': 1774970602.0}
2026-03-30 11:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RX64079') HTTP/1.1" 204 0
2026-03-30 11:25:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS22176/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:05 [scrapy.extensions.logstats] INFO: Crawled 211 pages (at 25 pages/min), scraped 167 items (at 16 items/min)
2026-03-30 11:25:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:25:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LS37547/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YT50077> (referer: https://www.auto1.com/v1/car-details-view/YT50077/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aadd70c4-52f7-5d33-8d7c-0adefc323cd7 with identifier: YT50077
2026-03-30 11:25:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aadd70c4-52f7-5d33-8d7c-0adefc323cd7 with scrape type 1
2026-03-30 11:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aadd70c4-52f7-5d33-8d7c-0adefc323cd7
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ffe%252F37fe940082bd3a220e4133dcaea61963%252Fpa%252FYT50077_415a7341537f0295a69017569cc6b16e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_415a7341537f0295a69017569cc6b16e.jpg already downloaded
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ffe%252F37fe940082bd3a220e4133dcaea61963%252Fpa%252FYT50077_065ed47acae4f2d96b9171376fdd28b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_065ed47acae4f2d96b9171376fdd28b4.jpg already downloaded
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ffe%252F37fe940082bd3a220e4133dcaea61963%252Fpa%252FYT50077_014f13292854dd62ef3e705b526adbbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_014f13292854dd62ef3e705b526adbbb.jpg already downloaded
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ffe%252F37fe940082bd3a220e4133dcaea61963%252Fpa%252FYT50077_49ddaa59d733cd69174e6e8c489aa294.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_49ddaa59d733cd69174e6e8c489aa294.jpg already downloaded
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ffe%252F37fe940082bd3a220e4133dcaea61963%252Fpa%252FYT50077_b28717151f910721080ce865dea4e7c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_b28717151f910721080ce865dea4e7c3.jpg already downloaded
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ffe%252F37fe940082bd3a220e4133dcaea61963%252Fpa%252FYT50077_02d45717980634fe5a6559ae0250e251.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_02d45717980634fe5a6559ae0250e251.jpg already downloaded
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ffe%252F37fe940082bd3a220e4133dcaea61963%252Fpa%252FYT50077_749b811a6fec73860f0a984c6ea70b00.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_749b811a6fec73860f0a984c6ea70b00.jpg already downloaded
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ffe%252F37fe940082bd3a220e4133dcaea61963%252Fpa%252FYT50077_3bfb58258378f14d7406306a212a1440.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_3bfb58258378f14d7406306a212a1440.jpg already downloaded
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ffe%252F37fe940082bd3a220e4133dcaea61963%252Fpa%252FYT50077_23b644cb9182136e162ec29cad2fce70.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_23b644cb9182136e162ec29cad2fce70.jpg already downloaded
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ffe%252F37fe940082bd3a220e4133dcaea61963%252Fpa%252FYT50077_62cfbe9360367d15ba84c4c65b0aaeda.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_62cfbe9360367d15ba84c4c65b0aaeda.jpg already downloaded
2026-03-30 11:25:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: aadd70c4-52f7-5d33-8d7c-0adefc323cd7, identifier: YT50077
2026-03-30 11:25:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: aadd70c4-52f7-5d33-8d7c-0adefc323cd7 with identifier: YT50077
2026-03-30 11:25:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: aadd70c4-52f7-5d33-8d7c-0adefc323cd7 with identifier: YT50077
2026-03-30 11:25:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: aadd70c4-52f7-5d33-8d7c-0adefc323cd7 with identifier: YT50077 to the API
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YT50077>
{'auction_title': '',
'c_o_2_emission_value': 148,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:20:06Z',
'fuel_type': 'petrol',
'id': 'aadd70c4-52f7-5d33-8d7c-0adefc323cd7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT50077',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Citroen',
'model': 'C3',
'odometer': 100957,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 19,
'photo_urls': ['https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_415a7341537f0295a69017569cc6b16e.jpg',
'https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_065ed47acae4f2d96b9171376fdd28b4.jpg',
'https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_014f13292854dd62ef3e705b526adbbb.jpg',
'https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_49ddaa59d733cd69174e6e8c489aa294.jpg',
'https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_b28717151f910721080ce865dea4e7c3.jpg',
'https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_02d45717980634fe5a6559ae0250e251.jpg',
'https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_749b811a6fec73860f0a984c6ea70b00.jpg',
'https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_3bfb58258378f14d7406306a212a1440.jpg',
'https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_23b644cb9182136e162ec29cad2fce70.jpg',
'https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_62cfbe9360367d15ba84c4c65b0aaeda.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aadd70c4-52f7-5d33-8d7c-0adefc323cd7/aadd70c4-52f7-5d33-8d7c-0adefc323cd7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_415a7341537f0295a69017569cc6b16e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aadd70c4-52f7-5d33-8d7c-0adefc323cd7/aadd70c4-52f7-5d33-8d7c-0adefc323cd7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_065ed47acae4f2d96b9171376fdd28b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aadd70c4-52f7-5d33-8d7c-0adefc323cd7/aadd70c4-52f7-5d33-8d7c-0adefc323cd7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49512,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_014f13292854dd62ef3e705b526adbbb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aadd70c4-52f7-5d33-8d7c-0adefc323cd7/aadd70c4-52f7-5d33-8d7c-0adefc323cd7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_49ddaa59d733cd69174e6e8c489aa294.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aadd70c4-52f7-5d33-8d7c-0adefc323cd7/aadd70c4-52f7-5d33-8d7c-0adefc323cd7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48667,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_b28717151f910721080ce865dea4e7c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aadd70c4-52f7-5d33-8d7c-0adefc323cd7/aadd70c4-52f7-5d33-8d7c-0adefc323cd7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53310,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_02d45717980634fe5a6559ae0250e251.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aadd70c4-52f7-5d33-8d7c-0adefc323cd7/aadd70c4-52f7-5d33-8d7c-0adefc323cd7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47154,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_749b811a6fec73860f0a984c6ea70b00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aadd70c4-52f7-5d33-8d7c-0adefc323cd7/aadd70c4-52f7-5d33-8d7c-0adefc323cd7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91345,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_3bfb58258378f14d7406306a212a1440.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aadd70c4-52f7-5d33-8d7c-0adefc323cd7/aadd70c4-52f7-5d33-8d7c-0adefc323cd7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72285,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_23b644cb9182136e162ec29cad2fce70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aadd70c4-52f7-5d33-8d7c-0adefc323cd7/aadd70c4-52f7-5d33-8d7c-0adefc323cd7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69103,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/fe/37fe940082bd3a220e4133dcaea61963/pa/YT50077_62cfbe9360367d15ba84c4c65b0aaeda.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2005-05-22',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.6 Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2005}
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT50077%27 HTTP/1.1" 200 None
2026-03-30 11:25:14 [auto1.fr] INFO: Saving data for YT50077: {'created_time': 1774869914.862642, 'last_price_update_time': 1774869914.862655, 'auction_closing_time': 1774970406.0}
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YT50077') HTTP/1.1" 204 0
2026-03-30 11:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZW51272> (referer: https://www.auto1.com/v1/car-details-view/ZW51272/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e49b32ad-a124-55cc-955f-b7f048364b1b with identifier: ZW51272
2026-03-30 11:25:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e49b32ad-a124-55cc-955f-b7f048364b1b with scrape type 1
2026-03-30 11:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e49b32ad-a124-55cc-955f-b7f048364b1b
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F69%252F6469a3265c02888398dc39a6df0036d6%252Fpa%252FZW51272_18387ed3a9eeba6e35209002040cbcbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_18387ed3a9eeba6e35209002040cbcbd.jpg not downloaded yet
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F69%252F6469a3265c02888398dc39a6df0036d6%252Fpa%252FZW51272_7cb52843b5e0a2e8c71cf36df0f4a9ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_7cb52843b5e0a2e8c71cf36df0f4a9ce.jpg not downloaded yet
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F69%252F6469a3265c02888398dc39a6df0036d6%252Fpa%252FZW51272_d5dca0fe7991ab5241d85ed8cee6f9e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_d5dca0fe7991ab5241d85ed8cee6f9e5.jpg not downloaded yet
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F69%252F6469a3265c02888398dc39a6df0036d6%252Fpa%252FZW51272_f961f806d2905575465612c52b5215fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_f961f806d2905575465612c52b5215fd.jpg not downloaded yet
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F69%252F6469a3265c02888398dc39a6df0036d6%252Fpa%252FZW51272_a4f0f77c69b69374b5d3c6b4f890b27f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_a4f0f77c69b69374b5d3c6b4f890b27f.jpg not downloaded yet
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F69%252F6469a3265c02888398dc39a6df0036d6%252Fpa%252FZW51272_33d45f9cec677e5b4960dfd180265d48.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_33d45f9cec677e5b4960dfd180265d48.jpg not downloaded yet
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F69%252F6469a3265c02888398dc39a6df0036d6%252Fpa%252FZW51272_9a1a6a585128fdec8f5b5609c231b432.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_9a1a6a585128fdec8f5b5609c231b432.jpg not downloaded yet
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F69%252F6469a3265c02888398dc39a6df0036d6%252Fpa%252FZW51272_f6563707ce9037c3d7ae91e71dbf1d29.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_f6563707ce9037c3d7ae91e71dbf1d29.jpg not downloaded yet
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F69%252F6469a3265c02888398dc39a6df0036d6%252Fpa%252FZW51272_1e6dfde2a9d0f01491d2bcd0206220b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_1e6dfde2a9d0f01491d2bcd0206220b4.jpg not downloaded yet
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F69%252F6469a3265c02888398dc39a6df0036d6%252Fpa%252FZW51272_3e7068e043756b6d91dccf3e88a06e39.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_3e7068e043756b6d91dccf3e88a06e39.jpg not downloaded yet
2026-03-30 11:25:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM66643/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_3e7068e043756b6d91dccf3e88a06e39.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384d6310>
2026-03-30 11:25:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e49b32ad-a124-55cc-955f-b7f048364b1b/e49b32ad-a124-55cc-955f-b7f048364b1b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F69%252F6469a3265c02888398dc39a6df0036d6%252Fpa%252FZW51272_3e7068e043756b6d91dccf3e88a06e39.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_3e7068e043756b6d91dccf3e88a06e39.jpg saved to cache
2026-03-30 11:25:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e49b32ad-a124-55cc-955f-b7f048364b1b
2026-03-30 11:25:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_1e6dfde2a9d0f01491d2bcd0206220b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384d6c10>
2026-03-30 11:25:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e49b32ad-a124-55cc-955f-b7f048364b1b/e49b32ad-a124-55cc-955f-b7f048364b1b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F69%252F6469a3265c02888398dc39a6df0036d6%252Fpa%252FZW51272_1e6dfde2a9d0f01491d2bcd0206220b4.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_1e6dfde2a9d0f01491d2bcd0206220b4.jpg saved to cache
2026-03-30 11:25:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e49b32ad-a124-55cc-955f-b7f048364b1b
2026-03-30 11:25:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MY85947> (referer: https://www.auto1.com/v1/car-details-view/MY85947/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_f6563707ce9037c3d7ae91e71dbf1d29.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32292697-4418-56e1-ad17-1350b3c42c14 with identifier: MY85947
2026-03-30 11:25:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32292697-4418-56e1-ad17-1350b3c42c14 with scrape type 1
2026-03-30 11:25:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 32292697-4418-56e1-ad17-1350b3c42c14
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F22%252F18227aeff816e506ee1396baf5289a94%252Fpa%252FMY85947_5c9b68a99e6b679b12f40fff07575e69.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_5c9b68a99e6b679b12f40fff07575e69.jpg already downloaded
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F22%252F18227aeff816e506ee1396baf5289a94%252Fpa%252FMY85947_193ce00e4d6ac0d88a2c2dd28c1fab3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_193ce00e4d6ac0d88a2c2dd28c1fab3b.jpg already downloaded
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F22%252F18227aeff816e506ee1396baf5289a94%252Fpa%252FMY85947_6d82517b478206cc1249545ffab23a73.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_6d82517b478206cc1249545ffab23a73.jpg already downloaded
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F22%252F18227aeff816e506ee1396baf5289a94%252Fpa%252FMY85947_a38ab79ee9b704b9cccdaf46825c2422.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_a38ab79ee9b704b9cccdaf46825c2422.jpg already downloaded
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F22%252F18227aeff816e506ee1396baf5289a94%252Fpa%252FMY85947_e9f5e62158a1d015a2dcec27bc1299aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_e9f5e62158a1d015a2dcec27bc1299aa.jpg already downloaded
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F22%252F18227aeff816e506ee1396baf5289a94%252Fpa%252FMY85947_3f61d9af2da56cd368da7f935d88ea2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_3f61d9af2da56cd368da7f935d88ea2d.jpg already downloaded
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F22%252F18227aeff816e506ee1396baf5289a94%252Fpa%252FMY85947_445e7c18a840542fc0b1dc97cf8f4d4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_445e7c18a840542fc0b1dc97cf8f4d4b.jpg already downloaded
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F22%252F18227aeff816e506ee1396baf5289a94%252Fpa%252FMY85947_8f18a259088bc96abdd1f14030aad4ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_8f18a259088bc96abdd1f14030aad4ee.jpg already downloaded
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F22%252F18227aeff816e506ee1396baf5289a94%252Fpa%252FMY85947_2d9f75123762123c33649e46f13467b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_2d9f75123762123c33649e46f13467b9.jpg already downloaded
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F22%252F18227aeff816e506ee1396baf5289a94%252Fpa%252FMY85947_84a45d638a96e5d5b3c9e11d093aa19c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_84a45d638a96e5d5b3c9e11d093aa19c.jpg already downloaded
2026-03-30 11:25:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 32292697-4418-56e1-ad17-1350b3c42c14, identifier: MY85947
2026-03-30 11:25:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 32292697-4418-56e1-ad17-1350b3c42c14 with identifier: MY85947
2026-03-30 11:25:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 32292697-4418-56e1-ad17-1350b3c42c14 with identifier: MY85947
2026-03-30 11:25:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 32292697-4418-56e1-ad17-1350b3c42c14 with identifier: MY85947 to the API
2026-03-30 11:25:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MY85947>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:41:53Z',
'fuel_type': 'petrol',
'id': '32292697-4418-56e1-ad17-1350b3c42c14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY85947',
'listing': 'auction',
'location': 'FR, Le Cellier',
'make': 'Peugeot',
'model': '208',
'odometer': 27134,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_5c9b68a99e6b679b12f40fff07575e69.jpg',
'https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_193ce00e4d6ac0d88a2c2dd28c1fab3b.jpg',
'https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_6d82517b478206cc1249545ffab23a73.jpg',
'https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_a38ab79ee9b704b9cccdaf46825c2422.jpg',
'https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_e9f5e62158a1d015a2dcec27bc1299aa.jpg',
'https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_3f61d9af2da56cd368da7f935d88ea2d.jpg',
'https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_445e7c18a840542fc0b1dc97cf8f4d4b.jpg',
'https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_8f18a259088bc96abdd1f14030aad4ee.jpg',
'https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_2d9f75123762123c33649e46f13467b9.jpg',
'https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_84a45d638a96e5d5b3c9e11d093aa19c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32292697-4418-56e1-ad17-1350b3c42c14/32292697-4418-56e1-ad17-1350b3c42c14_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69140,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_5c9b68a99e6b679b12f40fff07575e69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32292697-4418-56e1-ad17-1350b3c42c14/32292697-4418-56e1-ad17-1350b3c42c14_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_193ce00e4d6ac0d88a2c2dd28c1fab3b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32292697-4418-56e1-ad17-1350b3c42c14/32292697-4418-56e1-ad17-1350b3c42c14_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67903,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_6d82517b478206cc1249545ffab23a73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32292697-4418-56e1-ad17-1350b3c42c14/32292697-4418-56e1-ad17-1350b3c42c14_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47520,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_a38ab79ee9b704b9cccdaf46825c2422.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32292697-4418-56e1-ad17-1350b3c42c14/32292697-4418-56e1-ad17-1350b3c42c14_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57129,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_e9f5e62158a1d015a2dcec27bc1299aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32292697-4418-56e1-ad17-1350b3c42c14/32292697-4418-56e1-ad17-1350b3c42c14_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 259959,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_3f61d9af2da56cd368da7f935d88ea2d.jpg',
'Width': 1200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32292697-4418-56e1-ad17-1350b3c42c14/32292697-4418-56e1-ad17-1350b3c42c14_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228167,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_445e7c18a840542fc0b1dc97cf8f4d4b.jpg',
'Width': 1200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32292697-4418-56e1-ad17-1350b3c42c14/32292697-4418-56e1-ad17-1350b3c42c14_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254163,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_8f18a259088bc96abdd1f14030aad4ee.jpg',
'Width': 1200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32292697-4418-56e1-ad17-1350b3c42c14/32292697-4418-56e1-ad17-1350b3c42c14_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_2d9f75123762123c33649e46f13467b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32292697-4418-56e1-ad17-1350b3c42c14/32292697-4418-56e1-ad17-1350b3c42c14_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/22/18227aeff816e506ee1396baf5289a94/pa/MY85947_84a45d638a96e5d5b3c9e11d093aa19c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-11-13',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Like',
'transmission': 'manual',
'trim': 'Like',
'year': 2017}
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MY85947%27 HTTP/1.1" 200 None
2026-03-30 11:25:24 [auto1.fr] INFO: Saving data for MY85947: {'created_time': 1774869924.290554, 'last_price_update_time': 1774869924.290568, 'auction_closing_time': 1774971713.0}
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MY85947') HTTP/1.1" 204 0
2026-03-30 11:25:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_9a1a6a585128fdec8f5b5609c231b432.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738704450>
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e49b32ad-a124-55cc-955f-b7f048364b1b/e49b32ad-a124-55cc-955f-b7f048364b1b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F69%252F6469a3265c02888398dc39a6df0036d6%252Fpa%252FZW51272_f6563707ce9037c3d7ae91e71dbf1d29.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_f6563707ce9037c3d7ae91e71dbf1d29.jpg saved to cache
2026-03-30 11:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e49b32ad-a124-55cc-955f-b7f048364b1b
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a4b3350>
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e49b32ad-a124-55cc-955f-b7f048364b1b/e49b32ad-a124-55cc-955f-b7f048364b1b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F69%252F6469a3265c02888398dc39a6df0036d6%252Fpa%252FZW51272_9a1a6a585128fdec8f5b5609c231b432.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_9a1a6a585128fdec8f5b5609c231b432.jpg saved to cache
2026-03-30 11:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e49b32ad-a124-55cc-955f-b7f048364b1b
2026-03-30 11:25:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_33d45f9cec677e5b4960dfd180265d48.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_a4f0f77c69b69374b5d3c6b4f890b27f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383f2410>
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e49b32ad-a124-55cc-955f-b7f048364b1b/e49b32ad-a124-55cc-955f-b7f048364b1b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F69%252F6469a3265c02888398dc39a6df0036d6%252Fpa%252FZW51272_33d45f9cec677e5b4960dfd180265d48.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_33d45f9cec677e5b4960dfd180265d48.jpg saved to cache
2026-03-30 11:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e49b32ad-a124-55cc-955f-b7f048364b1b
2026-03-30 11:25:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_f961f806d2905575465612c52b5215fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738722350>
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e49b32ad-a124-55cc-955f-b7f048364b1b/e49b32ad-a124-55cc-955f-b7f048364b1b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F69%252F6469a3265c02888398dc39a6df0036d6%252Fpa%252FZW51272_a4f0f77c69b69374b5d3c6b4f890b27f.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_a4f0f77c69b69374b5d3c6b4f890b27f.jpg saved to cache
2026-03-30 11:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e49b32ad-a124-55cc-955f-b7f048364b1b
2026-03-30 11:25:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_d5dca0fe7991ab5241d85ed8cee6f9e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383f0e10>
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e49b32ad-a124-55cc-955f-b7f048364b1b/e49b32ad-a124-55cc-955f-b7f048364b1b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F69%252F6469a3265c02888398dc39a6df0036d6%252Fpa%252FZW51272_f961f806d2905575465612c52b5215fd.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_f961f806d2905575465612c52b5215fd.jpg saved to cache
2026-03-30 11:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e49b32ad-a124-55cc-955f-b7f048364b1b
2026-03-30 11:25:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_7cb52843b5e0a2e8c71cf36df0f4a9ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a4b2cd0>
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e49b32ad-a124-55cc-955f-b7f048364b1b/e49b32ad-a124-55cc-955f-b7f048364b1b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F69%252F6469a3265c02888398dc39a6df0036d6%252Fpa%252FZW51272_d5dca0fe7991ab5241d85ed8cee6f9e5.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_d5dca0fe7991ab5241d85ed8cee6f9e5.jpg saved to cache
2026-03-30 11:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e49b32ad-a124-55cc-955f-b7f048364b1b
2026-03-30 11:25:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_18387ed3a9eeba6e35209002040cbcbd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384d5450>
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e49b32ad-a124-55cc-955f-b7f048364b1b/e49b32ad-a124-55cc-955f-b7f048364b1b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F69%252F6469a3265c02888398dc39a6df0036d6%252Fpa%252FZW51272_7cb52843b5e0a2e8c71cf36df0f4a9ce.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_7cb52843b5e0a2e8c71cf36df0f4a9ce.jpg saved to cache
2026-03-30 11:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e49b32ad-a124-55cc-955f-b7f048364b1b
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384a5c50>
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e49b32ad-a124-55cc-955f-b7f048364b1b/e49b32ad-a124-55cc-955f-b7f048364b1b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F69%252F6469a3265c02888398dc39a6df0036d6%252Fpa%252FZW51272_18387ed3a9eeba6e35209002040cbcbd.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_18387ed3a9eeba6e35209002040cbcbd.jpg saved to cache
2026-03-30 11:25:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e49b32ad-a124-55cc-955f-b7f048364b1b
2026-03-30 11:25:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e49b32ad-a124-55cc-955f-b7f048364b1b, skipping ID generation
2026-03-30 11:25:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e49b32ad-a124-55cc-955f-b7f048364b1b with scrape type 1
2026-03-30 11:25:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e49b32ad-a124-55cc-955f-b7f048364b1b sending to next pipeline
2026-03-30 11:25:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e49b32ad-a124-55cc-955f-b7f048364b1b, identifier: ZW51272
2026-03-30 11:25:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e49b32ad-a124-55cc-955f-b7f048364b1b with identifier: ZW51272
2026-03-30 11:25:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e49b32ad-a124-55cc-955f-b7f048364b1b with identifier: ZW51272
2026-03-30 11:25:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e49b32ad-a124-55cc-955f-b7f048364b1b with identifier: ZW51272 to the API
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_18387ed3a9eeba6e35209002040cbcbd.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2026-03-31T15:40:06Z',
'fuel_type': 'diesel',
'id': 'e49b32ad-a124-55cc-955f-b7f048364b1b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW51272',
'listing': 'auction',
'location': 'Orvault',
'make': 'Peugeot',
'model': '208',
'odometer': 61294,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49b32ad-a124-55cc-955f-b7f048364b1b/e49b32ad-a124-55cc-955f-b7f048364b1b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_18387ed3a9eeba6e35209002040cbcbd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49b32ad-a124-55cc-955f-b7f048364b1b/e49b32ad-a124-55cc-955f-b7f048364b1b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94830,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_7cb52843b5e0a2e8c71cf36df0f4a9ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49b32ad-a124-55cc-955f-b7f048364b1b/e49b32ad-a124-55cc-955f-b7f048364b1b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90343,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_d5dca0fe7991ab5241d85ed8cee6f9e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49b32ad-a124-55cc-955f-b7f048364b1b/e49b32ad-a124-55cc-955f-b7f048364b1b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81716,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_f961f806d2905575465612c52b5215fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49b32ad-a124-55cc-955f-b7f048364b1b/e49b32ad-a124-55cc-955f-b7f048364b1b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98231,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_a4f0f77c69b69374b5d3c6b4f890b27f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49b32ad-a124-55cc-955f-b7f048364b1b/e49b32ad-a124-55cc-955f-b7f048364b1b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89356,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_33d45f9cec677e5b4960dfd180265d48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49b32ad-a124-55cc-955f-b7f048364b1b/e49b32ad-a124-55cc-955f-b7f048364b1b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83289,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_9a1a6a585128fdec8f5b5609c231b432.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49b32ad-a124-55cc-955f-b7f048364b1b/e49b32ad-a124-55cc-955f-b7f048364b1b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 130093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_f6563707ce9037c3d7ae91e71dbf1d29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49b32ad-a124-55cc-955f-b7f048364b1b/e49b32ad-a124-55cc-955f-b7f048364b1b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89959,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_1e6dfde2a9d0f01491d2bcd0206220b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49b32ad-a124-55cc-955f-b7f048364b1b/e49b32ad-a124-55cc-955f-b7f048364b1b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70795,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/69/6469a3265c02888398dc39a6df0036d6/pa/ZW51272_3e7068e043756b6d91dccf3e88a06e39.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.5 Blue-HDi Active Business R',
'transmission': 'manual',
'trim': 'Active Business R',
'year': 2023}
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW51272%27 HTTP/1.1" 200 None
2026-03-30 11:25:25 [auto1.fr] INFO: Saving data for ZW51272: {'created_time': 1774869925.615727, 'last_price_update_time': 1774869925.615737, 'auction_closing_time': 1774971606.0}
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZW51272') HTTP/1.1" 204 0
2026-03-30 11:25:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JF13819/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LE79705/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JV34550> (referer: https://www.auto1.com/v1/car-details-view/JV34550/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 673549c1-d061-5aec-a9f4-b00f3e3cf763 with identifier: JV34550
2026-03-30 11:25:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 673549c1-d061-5aec-a9f4-b00f3e3cf763 with scrape type 1
2026-03-30 11:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 673549c1-d061-5aec-a9f4-b00f3e3cf763
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F40%252F454017cc9d0fcdc59b242c0d276df4a7%252Fpa%252FJV34550_ce33eb96ca47a75fade4f4778de6aeba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_ce33eb96ca47a75fade4f4778de6aeba.jpg already downloaded
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F40%252F454017cc9d0fcdc59b242c0d276df4a7%252Fpa%252FJV34550_f9ad175c22a1ed44b15696025d5121a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_f9ad175c22a1ed44b15696025d5121a0.jpg already downloaded
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F40%252F454017cc9d0fcdc59b242c0d276df4a7%252Fpa%252FJV34550_6d92a95ce479012afc72f9af51f149fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_6d92a95ce479012afc72f9af51f149fe.jpg already downloaded
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F40%252F454017cc9d0fcdc59b242c0d276df4a7%252Fpa%252FJV34550_ca0ec5ebd95b80105c2794b6e8d2b96b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_ca0ec5ebd95b80105c2794b6e8d2b96b.jpg already downloaded
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F40%252F454017cc9d0fcdc59b242c0d276df4a7%252Fpa%252FJV34550_50180c0acc1b2ca13787fc0a8d37b944.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_50180c0acc1b2ca13787fc0a8d37b944.jpg already downloaded
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F40%252F454017cc9d0fcdc59b242c0d276df4a7%252Fpa%252FJV34550_49dcba803ff6871f73a992e2a1b46329.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_49dcba803ff6871f73a992e2a1b46329.jpg already downloaded
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F40%252F454017cc9d0fcdc59b242c0d276df4a7%252Fpa%252FJV34550_f9a46c35c36172f5e4add0005d1db2c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_f9a46c35c36172f5e4add0005d1db2c4.jpg already downloaded
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F40%252F454017cc9d0fcdc59b242c0d276df4a7%252Fpa%252FJV34550_7eef4d14b8384aeb0d4cf585164fe9e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_7eef4d14b8384aeb0d4cf585164fe9e1.jpg already downloaded
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F40%252F454017cc9d0fcdc59b242c0d276df4a7%252Fpa%252FJV34550_3425674197410e7b759d9ca26bca4711.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_3425674197410e7b759d9ca26bca4711.jpg already downloaded
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F40%252F454017cc9d0fcdc59b242c0d276df4a7%252Fpa%252FJV34550_bfb32a3a355225236bd47e295bd96f7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_bfb32a3a355225236bd47e295bd96f7f.jpg already downloaded
2026-03-30 11:25:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 673549c1-d061-5aec-a9f4-b00f3e3cf763, identifier: JV34550
2026-03-30 11:25:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 673549c1-d061-5aec-a9f4-b00f3e3cf763 with identifier: JV34550
2026-03-30 11:25:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 673549c1-d061-5aec-a9f4-b00f3e3cf763 with identifier: JV34550
2026-03-30 11:25:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 673549c1-d061-5aec-a9f4-b00f3e3cf763 with identifier: JV34550 to the API
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JV34550>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 300,
'expiration_date': '2026-03-31T15:12:34Z',
'fuel_type': 'petrol',
'id': '673549c1-d061-5aec-a9f4-b00f3e3cf763',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV34550',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Audi',
'model': 'S3',
'odometer': 211361,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_ce33eb96ca47a75fade4f4778de6aeba.jpg',
'https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_f9ad175c22a1ed44b15696025d5121a0.jpg',
'https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_6d92a95ce479012afc72f9af51f149fe.jpg',
'https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_ca0ec5ebd95b80105c2794b6e8d2b96b.jpg',
'https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_50180c0acc1b2ca13787fc0a8d37b944.jpg',
'https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_49dcba803ff6871f73a992e2a1b46329.jpg',
'https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_f9a46c35c36172f5e4add0005d1db2c4.jpg',
'https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_7eef4d14b8384aeb0d4cf585164fe9e1.jpg',
'https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_3425674197410e7b759d9ca26bca4711.jpg',
'https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_bfb32a3a355225236bd47e295bd96f7f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_673549c1-d061-5aec-a9f4-b00f3e3cf763/673549c1-d061-5aec-a9f4-b00f3e3cf763_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71505,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_ce33eb96ca47a75fade4f4778de6aeba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_673549c1-d061-5aec-a9f4-b00f3e3cf763/673549c1-d061-5aec-a9f4-b00f3e3cf763_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_f9ad175c22a1ed44b15696025d5121a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_673549c1-d061-5aec-a9f4-b00f3e3cf763/673549c1-d061-5aec-a9f4-b00f3e3cf763_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_6d92a95ce479012afc72f9af51f149fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_673549c1-d061-5aec-a9f4-b00f3e3cf763/673549c1-d061-5aec-a9f4-b00f3e3cf763_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65326,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_ca0ec5ebd95b80105c2794b6e8d2b96b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_673549c1-d061-5aec-a9f4-b00f3e3cf763/673549c1-d061-5aec-a9f4-b00f3e3cf763_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70101,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_50180c0acc1b2ca13787fc0a8d37b944.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_673549c1-d061-5aec-a9f4-b00f3e3cf763/673549c1-d061-5aec-a9f4-b00f3e3cf763_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77676,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_49dcba803ff6871f73a992e2a1b46329.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_673549c1-d061-5aec-a9f4-b00f3e3cf763/673549c1-d061-5aec-a9f4-b00f3e3cf763_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78558,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_f9a46c35c36172f5e4add0005d1db2c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_673549c1-d061-5aec-a9f4-b00f3e3cf763/673549c1-d061-5aec-a9f4-b00f3e3cf763_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68994,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_7eef4d14b8384aeb0d4cf585164fe9e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_673549c1-d061-5aec-a9f4-b00f3e3cf763/673549c1-d061-5aec-a9f4-b00f3e3cf763_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74354,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_3425674197410e7b759d9ca26bca4711.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_673549c1-d061-5aec-a9f4-b00f3e3cf763/673549c1-d061-5aec-a9f4-b00f3e3cf763_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75864,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/40/454017cc9d0fcdc59b242c0d276df4a7/pa/JV34550_bfb32a3a355225236bd47e295bd96f7f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-03-18',
'seats_number': 5,
'seller_name': None,
'title': 'Audi S3 2.0 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2015}
2026-03-30 11:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV34550%27 HTTP/1.1" 200 None
2026-03-30 11:25:39 [auto1.fr] INFO: Saving data for JV34550: {'created_time': 1774869939.112207, 'last_price_update_time': 1774869939.112217, 'auction_closing_time': 1774969954.0}
2026-03-30 11:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JV34550') HTTP/1.1" 204 0
2026-03-30 11:25:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL06097> (referer: https://www.auto1.com/v1/car-details-view/YL06097/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0128620c-0533-5513-a44b-f9184c5b8a3d with identifier: YL06097
2026-03-30 11:25:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0128620c-0533-5513-a44b-f9184c5b8a3d with scrape type 1
2026-03-30 11:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0128620c-0533-5513-a44b-f9184c5b8a3d
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F01%252F2b01119c7a3325dce99650299f0b9816%252Fpa%252FYL06097_9e3606b46c14a3d8dd3f431aac78478d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_9e3606b46c14a3d8dd3f431aac78478d.jpg already downloaded
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F01%252F2b01119c7a3325dce99650299f0b9816%252Fpa%252FYL06097_f9fbe8f477a852ea57a1f66ea1724989.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_f9fbe8f477a852ea57a1f66ea1724989.jpg already downloaded
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F01%252F2b01119c7a3325dce99650299f0b9816%252Fpa%252FYL06097_6c832047f63eb0f4ece2fa13439d75aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_6c832047f63eb0f4ece2fa13439d75aa.jpg already downloaded
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F01%252F2b01119c7a3325dce99650299f0b9816%252Fpa%252FYL06097_069f15311a1116bc64ea642f9968ffd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_069f15311a1116bc64ea642f9968ffd7.jpg already downloaded
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F01%252F2b01119c7a3325dce99650299f0b9816%252Fpa%252FYL06097_a56b53ca3dcac2e57e548b202fa38110.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_a56b53ca3dcac2e57e548b202fa38110.jpg already downloaded
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F01%252F2b01119c7a3325dce99650299f0b9816%252Fpa%252FYL06097_62040e47bfab76f1343722462823f6a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_62040e47bfab76f1343722462823f6a7.jpg already downloaded
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F01%252F2b01119c7a3325dce99650299f0b9816%252Fpa%252FYL06097_e4415fbdac9cbfb10b53d8d1ad68041b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_e4415fbdac9cbfb10b53d8d1ad68041b.jpg already downloaded
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F01%252F2b01119c7a3325dce99650299f0b9816%252Fpa%252FYL06097_fe4fe72aca021e249c9bda99384ede3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_fe4fe72aca021e249c9bda99384ede3b.jpg already downloaded
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F01%252F2b01119c7a3325dce99650299f0b9816%252Fpa%252FYL06097_090e4660a991df6d69e4794694d16d1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_090e4660a991df6d69e4794694d16d1b.jpg already downloaded
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F01%252F2b01119c7a3325dce99650299f0b9816%252Fpa%252FYL06097_cdd0f9bf480fe564c33b168eb66e8dd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_cdd0f9bf480fe564c33b168eb66e8dd8.jpg already downloaded
2026-03-30 11:25:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0128620c-0533-5513-a44b-f9184c5b8a3d, identifier: YL06097
2026-03-30 11:25:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0128620c-0533-5513-a44b-f9184c5b8a3d with identifier: YL06097
2026-03-30 11:25:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0128620c-0533-5513-a44b-f9184c5b8a3d with identifier: YL06097
2026-03-30 11:25:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0128620c-0533-5513-a44b-f9184c5b8a3d with identifier: YL06097 to the API
2026-03-30 11:25:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YL06097>
{'auction_title': '',
'c_o_2_emission_value': 165,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 313,
'expiration_date': '2026-03-31T15:52:30Z',
'fuel_type': 'diesel',
'id': '0128620c-0533-5513-a44b-f9184c5b8a3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL06097',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'BMW',
'model': 'X6',
'odometer': 189928,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photo_urls': ['https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_9e3606b46c14a3d8dd3f431aac78478d.jpg',
'https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_f9fbe8f477a852ea57a1f66ea1724989.jpg',
'https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_6c832047f63eb0f4ece2fa13439d75aa.jpg',
'https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_069f15311a1116bc64ea642f9968ffd7.jpg',
'https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_a56b53ca3dcac2e57e548b202fa38110.jpg',
'https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_62040e47bfab76f1343722462823f6a7.jpg',
'https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_e4415fbdac9cbfb10b53d8d1ad68041b.jpg',
'https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_fe4fe72aca021e249c9bda99384ede3b.jpg',
'https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_090e4660a991df6d69e4794694d16d1b.jpg',
'https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_cdd0f9bf480fe564c33b168eb66e8dd8.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0128620c-0533-5513-a44b-f9184c5b8a3d/0128620c-0533-5513-a44b-f9184c5b8a3d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57843,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_9e3606b46c14a3d8dd3f431aac78478d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0128620c-0533-5513-a44b-f9184c5b8a3d/0128620c-0533-5513-a44b-f9184c5b8a3d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_f9fbe8f477a852ea57a1f66ea1724989.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0128620c-0533-5513-a44b-f9184c5b8a3d/0128620c-0533-5513-a44b-f9184c5b8a3d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59503,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_6c832047f63eb0f4ece2fa13439d75aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0128620c-0533-5513-a44b-f9184c5b8a3d/0128620c-0533-5513-a44b-f9184c5b8a3d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43244,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_069f15311a1116bc64ea642f9968ffd7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0128620c-0533-5513-a44b-f9184c5b8a3d/0128620c-0533-5513-a44b-f9184c5b8a3d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50014,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_a56b53ca3dcac2e57e548b202fa38110.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0128620c-0533-5513-a44b-f9184c5b8a3d/0128620c-0533-5513-a44b-f9184c5b8a3d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_62040e47bfab76f1343722462823f6a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0128620c-0533-5513-a44b-f9184c5b8a3d/0128620c-0533-5513-a44b-f9184c5b8a3d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54910,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_e4415fbdac9cbfb10b53d8d1ad68041b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0128620c-0533-5513-a44b-f9184c5b8a3d/0128620c-0533-5513-a44b-f9184c5b8a3d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105356,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_fe4fe72aca021e249c9bda99384ede3b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0128620c-0533-5513-a44b-f9184c5b8a3d/0128620c-0533-5513-a44b-f9184c5b8a3d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81758,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_090e4660a991df6d69e4794694d16d1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0128620c-0533-5513-a44b-f9184c5b8a3d/0128620c-0533-5513-a44b-f9184c5b8a3d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/01/2b01119c7a3325dce99650299f0b9816/pa/YL06097_cdd0f9bf480fe564c33b168eb66e8dd8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-06',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X6 xDrive 40d',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL06097%27 HTTP/1.1" 200 None
2026-03-30 11:25:41 [auto1.fr] INFO: Saving data for YL06097: {'created_time': 1774869941.148485, 'last_price_update_time': 1774869941.148494, 'auction_closing_time': 1774972350.0}
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YL06097') HTTP/1.1" 204 0
2026-03-30 11:25:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:47 [auto1.fr] INFO: Channel: 24h | Page: 20 | totalHits: 5585 | hits on page: 40
2026-03-30 11:25:47 [auto1.fr] INFO: Found listing with ID: SK43844
2026-03-30 11:25:47 [auto1.fr] INFO: Found listing with ID: FX27811
2026-03-30 11:25:47 [auto1.fr] INFO: Found listing with ID: CT78208
2026-03-30 11:25:47 [auto1.fr] INFO: Found listing with ID: VT90507
2026-03-30 11:25:47 [auto1.fr] INFO: Found listing with ID: KH76929
2026-03-30 11:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH76929%27 HTTP/1.1" 200 None
2026-03-30 11:25:47 [auto1.fr] INFO: Scrape type for KH76929: 1
2026-03-30 11:25:47 [auto1.fr] INFO: Found listing with ID: AN07347
2026-03-30 11:25:47 [auto1.fr] INFO: Found listing with ID: HB98578
2026-03-30 11:25:47 [auto1.fr] INFO: Found listing with ID: RH39246
2026-03-30 11:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH39246%27 HTTP/1.1" 200 None
2026-03-30 11:25:47 [auto1.fr] INFO: Scrape type for RH39246: 1
2026-03-30 11:25:47 [auto1.fr] INFO: Found listing with ID: PY51333
2026-03-30 11:25:47 [auto1.fr] INFO: Found listing with ID: UA06834
2026-03-30 11:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA06834%27 HTTP/1.1" 200 None
2026-03-30 11:25:47 [auto1.fr] INFO: Scrape type for UA06834: 1
2026-03-30 11:25:47 [auto1.fr] INFO: Found listing with ID: JV30331
2026-03-30 11:25:47 [auto1.fr] INFO: Found listing with ID: LM24341
2026-03-30 11:25:47 [auto1.fr] INFO: Found listing with ID: VB98867
2026-03-30 11:25:47 [auto1.fr] INFO: Found listing with ID: YC82706
2026-03-30 11:25:47 [auto1.fr] INFO: Found listing with ID: EP61316
2026-03-30 11:25:47 [auto1.fr] INFO: Found listing with ID: JY39287
2026-03-30 11:25:47 [auto1.fr] INFO: Found listing with ID: LJ73279
2026-03-30 11:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ73279%27 HTTP/1.1" 200 None
2026-03-30 11:25:47 [auto1.fr] INFO: Scrape type for LJ73279: 1
2026-03-30 11:25:47 [auto1.fr] INFO: Found listing with ID: PU36088
2026-03-30 11:25:47 [auto1.fr] INFO: Found listing with ID: TE38674
2026-03-30 11:25:47 [auto1.fr] INFO: Found listing with ID: WV33218
2026-03-30 11:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV33218%27 HTTP/1.1" 200 None
2026-03-30 11:25:47 [auto1.fr] INFO: Scrape type for WV33218: 2
2026-03-30 11:25:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b00359a1-c5da-5890-9dd4-f6248981cf50 with identifier: WV33218
2026-03-30 11:25:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b00359a1-c5da-5890-9dd4-f6248981cf50 with scrape type 2
2026-03-30 11:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b00359a1-c5da-5890-9dd4-f6248981cf50 with scrape type 2
2026-03-30 11:25:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b00359a1-c5da-5890-9dd4-f6248981cf50, identifier: WV33218
2026-03-30 11:25:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b00359a1-c5da-5890-9dd4-f6248981cf50 with identifier: WV33218
2026-03-30 11:25:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b00359a1-c5da-5890-9dd4-f6248981cf50 with identifier: WV33218
2026-03-30 11:25:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b00359a1-c5da-5890-9dd4-f6248981cf50 with identifier: WV33218 to the API
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 258,
'expiration_date': '2026-03-31T15:05:24Z',
'fuel_type': 'petrol',
'id': 'b00359a1-c5da-5890-9dd4-f6248981cf50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV33218',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 149407,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-07-22',
'seller_name': None,
'title': 'BMW 3er 330i xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2007}
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV33218%27 HTTP/1.1" 200 None
2026-03-30 11:25:48 [auto1.fr] INFO: Saving data for WV33218: {'auction_closing_time': 1774969524.0, 'created_time': 1773432504.252494, 'last_price_update_time': 1774869948.40182}
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WV33218') HTTP/1.1" 204 0
2026-03-30 11:25:48 [auto1.fr] INFO: Found listing with ID: AX44661
2026-03-30 11:25:48 [auto1.fr] INFO: Found listing with ID: JC65585
2026-03-30 11:25:48 [auto1.fr] INFO: Found listing with ID: UZ77285
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ77285%27 HTTP/1.1" 200 None
2026-03-30 11:25:48 [auto1.fr] INFO: Scrape type for UZ77285: 2
2026-03-30 11:25:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a48259a-1b80-56e1-bb7e-75891ca6c6b3 with identifier: UZ77285
2026-03-30 11:25:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a48259a-1b80-56e1-bb7e-75891ca6c6b3 with scrape type 2
2026-03-30 11:25:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a48259a-1b80-56e1-bb7e-75891ca6c6b3 with scrape type 2
2026-03-30 11:25:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1a48259a-1b80-56e1-bb7e-75891ca6c6b3, identifier: UZ77285
2026-03-30 11:25:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1a48259a-1b80-56e1-bb7e-75891ca6c6b3 with identifier: UZ77285
2026-03-30 11:25:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1a48259a-1b80-56e1-bb7e-75891ca6c6b3 with identifier: UZ77285
2026-03-30 11:25:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1a48259a-1b80-56e1-bb7e-75891ca6c6b3 with identifier: UZ77285 to the API
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-31T15:29:45Z',
'fuel_type': 'hybrid',
'id': '1a48259a-1b80-56e1-bb7e-75891ca6c6b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ77285',
'listing': 'auction',
'make': 'Peugeot',
'model': '508',
'odometer': 199415,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-01',
'seller_name': None,
'title': 'Peugeot 508 2.0 HDi Hybrid4 RXH',
'transmission': 'automatic',
'trim': 'RXH',
'year': 2015}
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ77285%27 HTTP/1.1" 200 None
2026-03-30 11:25:48 [auto1.fr] INFO: Saving data for UZ77285: {'auction_closing_time': 1774970985.0, 'created_time': 1774279001.31208, 'last_price_update_time': 1774869948.96163}
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UZ77285') HTTP/1.1" 204 0
2026-03-30 11:25:48 [auto1.fr] INFO: Found listing with ID: CK52934
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CK52934%27 HTTP/1.1" 200 None
2026-03-30 11:25:48 [auto1.fr] INFO: Scrape type for CK52934: 2
2026-03-30 11:25:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcd4289d-1a42-5f11-b25b-0280fe87e069 with identifier: CK52934
2026-03-30 11:25:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcd4289d-1a42-5f11-b25b-0280fe87e069 with scrape type 2
2026-03-30 11:25:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcd4289d-1a42-5f11-b25b-0280fe87e069 with scrape type 2
2026-03-30 11:25:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bcd4289d-1a42-5f11-b25b-0280fe87e069, identifier: CK52934
2026-03-30 11:25:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bcd4289d-1a42-5f11-b25b-0280fe87e069 with identifier: CK52934
2026-03-30 11:25:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bcd4289d-1a42-5f11-b25b-0280fe87e069 with identifier: CK52934
2026-03-30 11:25:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bcd4289d-1a42-5f11-b25b-0280fe87e069 with identifier: CK52934 to the API
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:27:51Z',
'fuel_type': 'diesel',
'id': 'bcd4289d-1a42-5f11-b25b-0280fe87e069',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK52934',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 222744,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-08',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2017}
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CK52934%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.fr] INFO: Saving data for CK52934: {'auction_closing_time': 1774970871.0, 'created_time': 1774001958.515909, 'last_price_update_time': 1774869949.379733}
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CK52934') HTTP/1.1" 204 0
2026-03-30 11:25:49 [auto1.fr] INFO: Found listing with ID: ZL15775
2026-03-30 11:25:49 [auto1.fr] INFO: Found listing with ID: RN04117
2026-03-30 11:25:49 [auto1.fr] INFO: Found listing with ID: KK86719
2026-03-30 11:25:49 [auto1.fr] INFO: Found listing with ID: XE90293
2026-03-30 11:25:49 [auto1.fr] INFO: Found listing with ID: XK60858
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK60858%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.fr] INFO: Scrape type for XK60858: 2
2026-03-30 11:25:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fb3e8cf-2690-5f46-8546-5c06cd4c97e1 with identifier: XK60858
2026-03-30 11:25:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fb3e8cf-2690-5f46-8546-5c06cd4c97e1 with scrape type 2
2026-03-30 11:25:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fb3e8cf-2690-5f46-8546-5c06cd4c97e1 with scrape type 2
2026-03-30 11:25:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2fb3e8cf-2690-5f46-8546-5c06cd4c97e1, identifier: XK60858
2026-03-30 11:25:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2fb3e8cf-2690-5f46-8546-5c06cd4c97e1 with identifier: XK60858
2026-03-30 11:25:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2fb3e8cf-2690-5f46-8546-5c06cd4c97e1 with identifier: XK60858
2026-03-30 11:25:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2fb3e8cf-2690-5f46-8546-5c06cd4c97e1 with identifier: XK60858 to the API
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:36:56Z',
'fuel_type': 'diesel',
'id': '2fb3e8cf-2690-5f46-8546-5c06cd4c97e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK60858',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 165194,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-27',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro S Line',
'transmission': 'automatic',
'trim': 'quattro S Line',
'year': 2017}
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK60858%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.fr] INFO: Saving data for XK60858: {'auction_closing_time': 1774971416.0, 'created_time': 1773078040.270649, 'last_price_update_time': 1774869949.888132}
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XK60858') HTTP/1.1" 204 0
2026-03-30 11:25:49 [auto1.fr] INFO: Found listing with ID: UK90801
2026-03-30 11:25:49 [auto1.fr] INFO: Found listing with ID: RE89724
2026-03-30 11:25:49 [auto1.fr] INFO: Found listing with ID: VD81431
2026-03-30 11:25:49 [auto1.fr] INFO: Found listing with ID: UC03940
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC03940%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.fr] INFO: Scrape type for UC03940: 1
2026-03-30 11:25:49 [auto1.fr] INFO: Found listing with ID: YU78646
2026-03-30 11:25:49 [auto1.fr] INFO: Found listing with ID: UT37188
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT37188%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.fr] INFO: Scrape type for UT37188: 1
2026-03-30 11:25:49 [auto1.fr] INFO: Found listing with ID: MZ95816
2026-03-30 11:25:49 [auto1.fr] INFO: Found listing with ID: AS29663
2026-03-30 11:25:49 [auto1.fr] INFO: Found listing with ID: GR61820
2026-03-30 11:25:49 [auto1.fr] INFO: Found listing with ID: RL98096
2026-03-30 11:25:49 [auto1.fr] INFO: Found listing with ID: LN69242
2026-03-30 11:25:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LS37547> (referer: https://www.auto1.com/v1/car-details-view/LS37547/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51b72c91-faba-5920-ad86-a90272877c58 with identifier: LS37547
2026-03-30 11:25:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51b72c91-faba-5920-ad86-a90272877c58 with scrape type 1
2026-03-30 11:25:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 51b72c91-faba-5920-ad86-a90272877c58
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F8d%252F2e8d6593d26abc8275553541f5271d27%252Fpa%252FLS37547_92316e6bda7d983a6a81f00486b8ce59.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_92316e6bda7d983a6a81f00486b8ce59.jpg not downloaded yet
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F8d%252F2e8d6593d26abc8275553541f5271d27%252Fpa%252FLS37547_de89fdcef067fd24cac0a97feb9bdf48.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_de89fdcef067fd24cac0a97feb9bdf48.jpg not downloaded yet
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F8d%252F2e8d6593d26abc8275553541f5271d27%252Fpa%252FLS37547_4b0dc1eec74c684437f03827b1297e77.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_4b0dc1eec74c684437f03827b1297e77.jpg not downloaded yet
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F8d%252F2e8d6593d26abc8275553541f5271d27%252Fpa%252FLS37547_5d07de84608f94ffb32c39df420f692b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_5d07de84608f94ffb32c39df420f692b.jpg not downloaded yet
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F8d%252F2e8d6593d26abc8275553541f5271d27%252Fpa%252FLS37547_6695d971ae9b5c27dbd181fc312b91dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_6695d971ae9b5c27dbd181fc312b91dd.jpg not downloaded yet
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F8d%252F2e8d6593d26abc8275553541f5271d27%252Fpa%252FLS37547_57e3bde62b6b5ace9a52ff94d6682d84.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_57e3bde62b6b5ace9a52ff94d6682d84.jpg not downloaded yet
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F8d%252F2e8d6593d26abc8275553541f5271d27%252Fpa%252FLS37547_5a668c4597b440460cd77656b98eccad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_5a668c4597b440460cd77656b98eccad.jpg not downloaded yet
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F8d%252F2e8d6593d26abc8275553541f5271d27%252Fpa%252FLS37547_1ebc58a1c9ef464883210f3187289ffc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_1ebc58a1c9ef464883210f3187289ffc.jpg not downloaded yet
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F8d%252F2e8d6593d26abc8275553541f5271d27%252Fpa%252FLS37547_eb9529aadab41616d4a9e34fb6a840a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_eb9529aadab41616d4a9e34fb6a840a1.jpg not downloaded yet
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F8d%252F2e8d6593d26abc8275553541f5271d27%252Fpa%252FLS37547_78f6b6ea50646f276453eb98732ca938.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_78f6b6ea50646f276453eb98732ca938.jpg not downloaded yet
2026-03-30 11:25:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH02703> (referer: https://www.auto1.com/v1/car-details-view/KH02703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_78f6b6ea50646f276453eb98732ca938.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d75f091d-afe1-5908-a561-bf5125cf3665 with identifier: KH02703
2026-03-30 11:25:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d75f091d-afe1-5908-a561-bf5125cf3665 with scrape type 1
2026-03-30 11:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d75f091d-afe1-5908-a561-bf5125cf3665
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fd9%252F1cd9244a88d194b2f889c74dda1698a7%252Fpa%252FKH02703_afccfdcd3f2277ebe81a4b159ec45f32.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_afccfdcd3f2277ebe81a4b159ec45f32.jpg not downloaded yet
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fd9%252F1cd9244a88d194b2f889c74dda1698a7%252Fpa%252FKH02703_7fcf6e23de21e8b3dae0bb6eecbee55d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_7fcf6e23de21e8b3dae0bb6eecbee55d.jpg not downloaded yet
2026-03-30 11:25:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_eb9529aadab41616d4a9e34fb6a840a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fd9%252F1cd9244a88d194b2f889c74dda1698a7%252Fpa%252FKH02703_9563c6e341568d928e4afe9f5ec33d78.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_9563c6e341568d928e4afe9f5ec33d78.jpg not downloaded yet
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fd9%252F1cd9244a88d194b2f889c74dda1698a7%252Fpa%252FKH02703_9afb50b6aee98a0de87fe108fa66cc64.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_9afb50b6aee98a0de87fe108fa66cc64.jpg not downloaded yet
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fd9%252F1cd9244a88d194b2f889c74dda1698a7%252Fpa%252FKH02703_374624cc4c9fc7a96de535d647189e24.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_374624cc4c9fc7a96de535d647189e24.jpg not downloaded yet
2026-03-30 11:25:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383bfcd0>
2026-03-30 11:25:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51b72c91-faba-5920-ad86-a90272877c58/51b72c91-faba-5920-ad86-a90272877c58_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F8d%252F2e8d6593d26abc8275553541f5271d27%252Fpa%252FLS37547_78f6b6ea50646f276453eb98732ca938.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_78f6b6ea50646f276453eb98732ca938.jpg saved to cache
2026-03-30 11:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 51b72c91-faba-5920-ad86-a90272877c58
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fd9%252F1cd9244a88d194b2f889c74dda1698a7%252Fpa%252FKH02703_b1ee75b11dd2a99556c79e4d64e1f67a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_b1ee75b11dd2a99556c79e4d64e1f67a.jpg not downloaded yet
2026-03-30 11:25:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_7fcf6e23de21e8b3dae0bb6eecbee55d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383ebd50>
2026-03-30 11:25:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51b72c91-faba-5920-ad86-a90272877c58/51b72c91-faba-5920-ad86-a90272877c58_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F8d%252F2e8d6593d26abc8275553541f5271d27%252Fpa%252FLS37547_eb9529aadab41616d4a9e34fb6a840a1.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_eb9529aadab41616d4a9e34fb6a840a1.jpg saved to cache
2026-03-30 11:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 51b72c91-faba-5920-ad86-a90272877c58
2026-03-30 11:25:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738584e10>
2026-03-30 11:25:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75f091d-afe1-5908-a561-bf5125cf3665/d75f091d-afe1-5908-a561-bf5125cf3665_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fd9%252F1cd9244a88d194b2f889c74dda1698a7%252Fpa%252FKH02703_7fcf6e23de21e8b3dae0bb6eecbee55d.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_7fcf6e23de21e8b3dae0bb6eecbee55d.jpg saved to cache
2026-03-30 11:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d75f091d-afe1-5908-a561-bf5125cf3665
2026-03-30 11:25:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_374624cc4c9fc7a96de535d647189e24.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_b1ee75b11dd2a99556c79e4d64e1f67a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383d3e50>
2026-03-30 11:25:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75f091d-afe1-5908-a561-bf5125cf3665/d75f091d-afe1-5908-a561-bf5125cf3665_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fd9%252F1cd9244a88d194b2f889c74dda1698a7%252Fpa%252FKH02703_374624cc4c9fc7a96de535d647189e24.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_374624cc4c9fc7a96de535d647189e24.jpg saved to cache
2026-03-30 11:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d75f091d-afe1-5908-a561-bf5125cf3665
2026-03-30 11:25:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_9afb50b6aee98a0de87fe108fa66cc64.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738712a90>
2026-03-30 11:25:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75f091d-afe1-5908-a561-bf5125cf3665/d75f091d-afe1-5908-a561-bf5125cf3665_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fd9%252F1cd9244a88d194b2f889c74dda1698a7%252Fpa%252FKH02703_b1ee75b11dd2a99556c79e4d64e1f67a.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_b1ee75b11dd2a99556c79e4d64e1f67a.jpg saved to cache
2026-03-30 11:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d75f091d-afe1-5908-a561-bf5125cf3665
2026-03-30 11:25:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_9563c6e341568d928e4afe9f5ec33d78.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a8f8050>
2026-03-30 11:25:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75f091d-afe1-5908-a561-bf5125cf3665/d75f091d-afe1-5908-a561-bf5125cf3665_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fd9%252F1cd9244a88d194b2f889c74dda1698a7%252Fpa%252FKH02703_9afb50b6aee98a0de87fe108fa66cc64.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_9afb50b6aee98a0de87fe108fa66cc64.jpg saved to cache
2026-03-30 11:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d75f091d-afe1-5908-a561-bf5125cf3665
2026-03-30 11:25:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_afccfdcd3f2277ebe81a4b159ec45f32.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:54 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.387(s), this was the 2nd time calling it.
2026-03-30 11:25:54 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.960239400209662 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:25:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738426e50>
2026-03-30 11:25:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75f091d-afe1-5908-a561-bf5125cf3665/d75f091d-afe1-5908-a561-bf5125cf3665_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fd9%252F1cd9244a88d194b2f889c74dda1698a7%252Fpa%252FKH02703_9563c6e341568d928e4afe9f5ec33d78.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_9563c6e341568d928e4afe9f5ec33d78.jpg saved to cache
2026-03-30 11:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d75f091d-afe1-5908-a561-bf5125cf3665
2026-03-30 11:25:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_1ebc58a1c9ef464883210f3187289ffc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384a65d0>
2026-03-30 11:25:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75f091d-afe1-5908-a561-bf5125cf3665/d75f091d-afe1-5908-a561-bf5125cf3665_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fd9%252F1cd9244a88d194b2f889c74dda1698a7%252Fpa%252FKH02703_afccfdcd3f2277ebe81a4b159ec45f32.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_afccfdcd3f2277ebe81a4b159ec45f32.jpg saved to cache
2026-03-30 11:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d75f091d-afe1-5908-a561-bf5125cf3665
2026-03-30 11:25:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d75f091d-afe1-5908-a561-bf5125cf3665, skipping ID generation
2026-03-30 11:25:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d75f091d-afe1-5908-a561-bf5125cf3665 with scrape type 1
2026-03-30 11:25:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d75f091d-afe1-5908-a561-bf5125cf3665 sending to next pipeline
2026-03-30 11:25:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d75f091d-afe1-5908-a561-bf5125cf3665, identifier: KH02703
2026-03-30 11:25:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d75f091d-afe1-5908-a561-bf5125cf3665 with identifier: KH02703
2026-03-30 11:25:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d75f091d-afe1-5908-a561-bf5125cf3665 with identifier: KH02703
2026-03-30 11:25:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d75f091d-afe1-5908-a561-bf5125cf3665 with identifier: KH02703 to the API
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_afccfdcd3f2277ebe81a4b159ec45f32.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.7L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:48:08Z',
'fuel_type': 'diesel',
'id': 'd75f091d-afe1-5908-a561-bf5125cf3665',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH02703',
'listing': 'auction',
'location': 'FR, Pau',
'make': 'Opel',
'model': 'Zafira',
'odometer': 212497,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75f091d-afe1-5908-a561-bf5125cf3665/d75f091d-afe1-5908-a561-bf5125cf3665_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81542,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_afccfdcd3f2277ebe81a4b159ec45f32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75f091d-afe1-5908-a561-bf5125cf3665/d75f091d-afe1-5908-a561-bf5125cf3665_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83775,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_7fcf6e23de21e8b3dae0bb6eecbee55d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75f091d-afe1-5908-a561-bf5125cf3665/d75f091d-afe1-5908-a561-bf5125cf3665_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82346,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_9563c6e341568d928e4afe9f5ec33d78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75f091d-afe1-5908-a561-bf5125cf3665/d75f091d-afe1-5908-a561-bf5125cf3665_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_9afb50b6aee98a0de87fe108fa66cc64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75f091d-afe1-5908-a561-bf5125cf3665/d75f091d-afe1-5908-a561-bf5125cf3665_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99784,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_374624cc4c9fc7a96de535d647189e24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75f091d-afe1-5908-a561-bf5125cf3665/d75f091d-afe1-5908-a561-bf5125cf3665_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37759,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/d9/1cd9244a88d194b2f889c74dda1698a7/pa/KH02703_b1ee75b11dd2a99556c79e4d64e1f67a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-06-03',
'seats_number': 7,
'seller_name': None,
'title': 'Opel Zafira 1.7 CDTI Edition "111 Jahre"',
'transmission': 'manual',
'trim': 'Edition "111 Jahre"',
'year': 2010}
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH02703%27 HTTP/1.1" 200 None
2026-03-30 11:25:54 [auto1.fr] INFO: Saving data for KH02703: {'created_time': 1774869954.732683, 'last_price_update_time': 1774869954.732694, 'auction_closing_time': 1774972088.0}
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KH02703') HTTP/1.1" 204 0
2026-03-30 11:25:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_5a668c4597b440460cd77656b98eccad.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384a4510>
2026-03-30 11:25:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51b72c91-faba-5920-ad86-a90272877c58/51b72c91-faba-5920-ad86-a90272877c58_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F8d%252F2e8d6593d26abc8275553541f5271d27%252Fpa%252FLS37547_1ebc58a1c9ef464883210f3187289ffc.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_1ebc58a1c9ef464883210f3187289ffc.jpg saved to cache
2026-03-30 11:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 51b72c91-faba-5920-ad86-a90272877c58
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384cb510>
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51b72c91-faba-5920-ad86-a90272877c58/51b72c91-faba-5920-ad86-a90272877c58_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F8d%252F2e8d6593d26abc8275553541f5271d27%252Fpa%252FLS37547_5a668c4597b440460cd77656b98eccad.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_5a668c4597b440460cd77656b98eccad.jpg saved to cache
2026-03-30 11:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 51b72c91-faba-5920-ad86-a90272877c58
2026-03-30 11:25:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_57e3bde62b6b5ace9a52ff94d6682d84.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_6695d971ae9b5c27dbd181fc312b91dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07387045d0>
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51b72c91-faba-5920-ad86-a90272877c58/51b72c91-faba-5920-ad86-a90272877c58_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F8d%252F2e8d6593d26abc8275553541f5271d27%252Fpa%252FLS37547_57e3bde62b6b5ace9a52ff94d6682d84.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_57e3bde62b6b5ace9a52ff94d6682d84.jpg saved to cache
2026-03-30 11:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 51b72c91-faba-5920-ad86-a90272877c58
2026-03-30 11:25:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_5d07de84608f94ffb32c39df420f692b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738560c50>
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51b72c91-faba-5920-ad86-a90272877c58/51b72c91-faba-5920-ad86-a90272877c58_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F8d%252F2e8d6593d26abc8275553541f5271d27%252Fpa%252FLS37547_6695d971ae9b5c27dbd181fc312b91dd.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_6695d971ae9b5c27dbd181fc312b91dd.jpg saved to cache
2026-03-30 11:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51b72c91-faba-5920-ad86-a90272877c58
2026-03-30 11:25:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_4b0dc1eec74c684437f03827b1297e77.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738444a10>
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51b72c91-faba-5920-ad86-a90272877c58/51b72c91-faba-5920-ad86-a90272877c58_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F8d%252F2e8d6593d26abc8275553541f5271d27%252Fpa%252FLS37547_5d07de84608f94ffb32c39df420f692b.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_5d07de84608f94ffb32c39df420f692b.jpg saved to cache
2026-03-30 11:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51b72c91-faba-5920-ad86-a90272877c58
2026-03-30 11:25:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_de89fdcef067fd24cac0a97feb9bdf48.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738720a50>
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51b72c91-faba-5920-ad86-a90272877c58/51b72c91-faba-5920-ad86-a90272877c58_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F8d%252F2e8d6593d26abc8275553541f5271d27%252Fpa%252FLS37547_4b0dc1eec74c684437f03827b1297e77.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_4b0dc1eec74c684437f03827b1297e77.jpg saved to cache
2026-03-30 11:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51b72c91-faba-5920-ad86-a90272877c58
2026-03-30 11:25:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_92316e6bda7d983a6a81f00486b8ce59.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383ea710>
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51b72c91-faba-5920-ad86-a90272877c58/51b72c91-faba-5920-ad86-a90272877c58_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F8d%252F2e8d6593d26abc8275553541f5271d27%252Fpa%252FLS37547_de89fdcef067fd24cac0a97feb9bdf48.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_de89fdcef067fd24cac0a97feb9bdf48.jpg saved to cache
2026-03-30 11:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51b72c91-faba-5920-ad86-a90272877c58
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738716b10>
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51b72c91-faba-5920-ad86-a90272877c58/51b72c91-faba-5920-ad86-a90272877c58_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F8d%252F2e8d6593d26abc8275553541f5271d27%252Fpa%252FLS37547_92316e6bda7d983a6a81f00486b8ce59.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_92316e6bda7d983a6a81f00486b8ce59.jpg saved to cache
2026-03-30 11:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51b72c91-faba-5920-ad86-a90272877c58
2026-03-30 11:25:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51b72c91-faba-5920-ad86-a90272877c58, skipping ID generation
2026-03-30 11:25:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51b72c91-faba-5920-ad86-a90272877c58 with scrape type 1
2026-03-30 11:25:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51b72c91-faba-5920-ad86-a90272877c58 sending to next pipeline
2026-03-30 11:25:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 51b72c91-faba-5920-ad86-a90272877c58, identifier: LS37547
2026-03-30 11:25:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 51b72c91-faba-5920-ad86-a90272877c58 with identifier: LS37547
2026-03-30 11:25:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 51b72c91-faba-5920-ad86-a90272877c58 with identifier: LS37547
2026-03-30 11:25:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 51b72c91-faba-5920-ad86-a90272877c58 with identifier: LS37547 to the API
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_92316e6bda7d983a6a81f00486b8ce59.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:15:07Z',
'fuel_type': 'diesel',
'id': '51b72c91-faba-5920-ad86-a90272877c58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS37547',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'BMW',
'model': 'X1',
'odometer': 121919,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51b72c91-faba-5920-ad86-a90272877c58/51b72c91-faba-5920-ad86-a90272877c58_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140477,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_92316e6bda7d983a6a81f00486b8ce59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51b72c91-faba-5920-ad86-a90272877c58/51b72c91-faba-5920-ad86-a90272877c58_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_de89fdcef067fd24cac0a97feb9bdf48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51b72c91-faba-5920-ad86-a90272877c58/51b72c91-faba-5920-ad86-a90272877c58_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_4b0dc1eec74c684437f03827b1297e77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51b72c91-faba-5920-ad86-a90272877c58/51b72c91-faba-5920-ad86-a90272877c58_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92933,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_5d07de84608f94ffb32c39df420f692b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51b72c91-faba-5920-ad86-a90272877c58/51b72c91-faba-5920-ad86-a90272877c58_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_6695d971ae9b5c27dbd181fc312b91dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51b72c91-faba-5920-ad86-a90272877c58/51b72c91-faba-5920-ad86-a90272877c58_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123506,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_57e3bde62b6b5ace9a52ff94d6682d84.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51b72c91-faba-5920-ad86-a90272877c58/51b72c91-faba-5920-ad86-a90272877c58_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_5a668c4597b440460cd77656b98eccad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51b72c91-faba-5920-ad86-a90272877c58/51b72c91-faba-5920-ad86-a90272877c58_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_1ebc58a1c9ef464883210f3187289ffc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51b72c91-faba-5920-ad86-a90272877c58/51b72c91-faba-5920-ad86-a90272877c58_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_eb9529aadab41616d4a9e34fb6a840a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51b72c91-faba-5920-ad86-a90272877c58/51b72c91-faba-5920-ad86-a90272877c58_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55478,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/8d/2e8d6593d26abc8275553541f5271d27/pa/LS37547_78f6b6ea50646f276453eb98732ca938.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-06',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 sDrive 18d Lounge',
'transmission': 'automatic',
'trim': 'Lounge',
'year': 2022}
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LS37547%27 HTTP/1.1" 200 None
2026-03-30 11:25:56 [auto1.fr] INFO: Saving data for LS37547: {'created_time': 1774869956.129366, 'last_price_update_time': 1774869956.129381, 'auction_closing_time': 1774970107.0}
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LS37547') HTTP/1.1" 204 0
2026-03-30 11:25:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM66643> (referer: https://www.auto1.com/v1/car-details-view/PM66643/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3482567-4d7b-5555-9a1d-b55857ceddf3 with identifier: PM66643
2026-03-30 11:25:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3482567-4d7b-5555-9a1d-b55857ceddf3 with scrape type 1
2026-03-30 11:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e3482567-4d7b-5555-9a1d-b55857ceddf3
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff7%252F7ef793803f1cc21d9396bef33f403987%252Fpa%252FPM66643_8bea671b905bb08c34e73ff74d252878.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_8bea671b905bb08c34e73ff74d252878.jpg not downloaded yet
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff7%252F7ef793803f1cc21d9396bef33f403987%252Fpa%252FPM66643_a8b676b62071a1aaa9db850b68d1f1bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_a8b676b62071a1aaa9db850b68d1f1bb.jpg not downloaded yet
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff7%252F7ef793803f1cc21d9396bef33f403987%252Fpa%252FPM66643_1ec43af44f118106320c762a2750e0f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_1ec43af44f118106320c762a2750e0f6.jpg not downloaded yet
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff7%252F7ef793803f1cc21d9396bef33f403987%252Fpa%252FPM66643_b36e06ed80623abb34c43034c50fe405.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_b36e06ed80623abb34c43034c50fe405.jpg not downloaded yet
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff7%252F7ef793803f1cc21d9396bef33f403987%252Fpa%252FPM66643_1fedddaaed0d36d9539902aac14ad57c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_1fedddaaed0d36d9539902aac14ad57c.jpg not downloaded yet
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff7%252F7ef793803f1cc21d9396bef33f403987%252Fpa%252FPM66643_f750608710c83b4b5625398252e6de59.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_f750608710c83b4b5625398252e6de59.jpg not downloaded yet
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff7%252F7ef793803f1cc21d9396bef33f403987%252Fpa%252FPM66643_7012d2259621433b0539f0293d0d4a0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_7012d2259621433b0539f0293d0d4a0f.jpg not downloaded yet
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff7%252F7ef793803f1cc21d9396bef33f403987%252Fpa%252FPM66643_cb965e18e217f925f4af7c7bd6c60c81.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_cb965e18e217f925f4af7c7bd6c60c81.jpg not downloaded yet
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff7%252F7ef793803f1cc21d9396bef33f403987%252Fpa%252FPM66643_0c03b98f9472f249310e541c386e0276.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_0c03b98f9472f249310e541c386e0276.jpg not downloaded yet
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff7%252F7ef793803f1cc21d9396bef33f403987%252Fpa%252FPM66643_570529418fb3258b5111357913d847cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_570529418fb3258b5111357913d847cf.jpg not downloaded yet
2026-03-30 11:26:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:26:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ET54199> (referer: https://www.auto1.com/v1/car-details-view/ET54199/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eb55a90-28b1-5a10-9999-d2f0cdc17714 with identifier: ET54199
2026-03-30 11:26:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eb55a90-28b1-5a10-9999-d2f0cdc17714 with scrape type 1
2026-03-30 11:26:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2eb55a90-28b1-5a10-9999-d2f0cdc17714
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F9378f23cc1dd5d1a75e37da3bb7c262f%252Fpa%252FET54199_0f681f1ba894d1ffad9328f369f0bdbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_0f681f1ba894d1ffad9328f369f0bdbd.jpg already downloaded
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F9378f23cc1dd5d1a75e37da3bb7c262f%252Fpa%252FET54199_085435f47ca2317083a0601d86307123.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_085435f47ca2317083a0601d86307123.jpg already downloaded
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F9378f23cc1dd5d1a75e37da3bb7c262f%252Fpa%252FET54199_d83b5e06050f6a70a6369519cb371140.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_d83b5e06050f6a70a6369519cb371140.jpg already downloaded
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F9378f23cc1dd5d1a75e37da3bb7c262f%252Fpa%252FET54199_fabec26ce3e018ce0f9e392b54774f12.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_fabec26ce3e018ce0f9e392b54774f12.jpg already downloaded
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F9378f23cc1dd5d1a75e37da3bb7c262f%252Fpa%252FET54199_cfbc845e67bce32cd05cb98ba059acb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_cfbc845e67bce32cd05cb98ba059acb9.jpg already downloaded
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F9378f23cc1dd5d1a75e37da3bb7c262f%252Fpa%252FET54199_3fec22d6d07e82b6c8fcb987bd3f8e34.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_3fec22d6d07e82b6c8fcb987bd3f8e34.jpg already downloaded
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F9378f23cc1dd5d1a75e37da3bb7c262f%252Fpa%252FET54199_8b4b8cb87804cd1d3469d3956a44be2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_8b4b8cb87804cd1d3469d3956a44be2f.jpg already downloaded
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F9378f23cc1dd5d1a75e37da3bb7c262f%252Fpa%252FET54199_69792de6071260b342a2cbe9778fb8a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_69792de6071260b342a2cbe9778fb8a1.jpg already downloaded
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F9378f23cc1dd5d1a75e37da3bb7c262f%252Fpa%252FET54199_9bf70c3e14545e5f3e105b5e04ede304.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_9bf70c3e14545e5f3e105b5e04ede304.jpg already downloaded
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F78%252F9378f23cc1dd5d1a75e37da3bb7c262f%252Fpa%252FET54199_b992da882b936913e2f70020e6e60214.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_b992da882b936913e2f70020e6e60214.jpg already downloaded
2026-03-30 11:26:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2eb55a90-28b1-5a10-9999-d2f0cdc17714, identifier: ET54199
2026-03-30 11:26:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2eb55a90-28b1-5a10-9999-d2f0cdc17714 with identifier: ET54199
2026-03-30 11:26:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2eb55a90-28b1-5a10-9999-d2f0cdc17714 with identifier: ET54199
2026-03-30 11:26:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2eb55a90-28b1-5a10-9999-d2f0cdc17714 with identifier: ET54199 to the API
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ET54199>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:52:27Z',
'fuel_type': 'diesel',
'id': '2eb55a90-28b1-5a10-9999-d2f0cdc17714',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET54199',
'listing': 'auction',
'location': 'Saint Herblain',
'make': 'BMW',
'model': '3er',
'odometer': 284705,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_0f681f1ba894d1ffad9328f369f0bdbd.jpg',
'https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_085435f47ca2317083a0601d86307123.jpg',
'https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_d83b5e06050f6a70a6369519cb371140.jpg',
'https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_fabec26ce3e018ce0f9e392b54774f12.jpg',
'https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_cfbc845e67bce32cd05cb98ba059acb9.jpg',
'https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_3fec22d6d07e82b6c8fcb987bd3f8e34.jpg',
'https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_8b4b8cb87804cd1d3469d3956a44be2f.jpg',
'https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_69792de6071260b342a2cbe9778fb8a1.jpg',
'https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_9bf70c3e14545e5f3e105b5e04ede304.jpg',
'https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_b992da882b936913e2f70020e6e60214.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb55a90-28b1-5a10-9999-d2f0cdc17714/2eb55a90-28b1-5a10-9999-d2f0cdc17714_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83247,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_0f681f1ba894d1ffad9328f369f0bdbd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb55a90-28b1-5a10-9999-d2f0cdc17714/2eb55a90-28b1-5a10-9999-d2f0cdc17714_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_085435f47ca2317083a0601d86307123.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb55a90-28b1-5a10-9999-d2f0cdc17714/2eb55a90-28b1-5a10-9999-d2f0cdc17714_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_d83b5e06050f6a70a6369519cb371140.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb55a90-28b1-5a10-9999-d2f0cdc17714/2eb55a90-28b1-5a10-9999-d2f0cdc17714_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66344,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_fabec26ce3e018ce0f9e392b54774f12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb55a90-28b1-5a10-9999-d2f0cdc17714/2eb55a90-28b1-5a10-9999-d2f0cdc17714_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_cfbc845e67bce32cd05cb98ba059acb9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb55a90-28b1-5a10-9999-d2f0cdc17714/2eb55a90-28b1-5a10-9999-d2f0cdc17714_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77707,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_3fec22d6d07e82b6c8fcb987bd3f8e34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb55a90-28b1-5a10-9999-d2f0cdc17714/2eb55a90-28b1-5a10-9999-d2f0cdc17714_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65320,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_8b4b8cb87804cd1d3469d3956a44be2f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb55a90-28b1-5a10-9999-d2f0cdc17714/2eb55a90-28b1-5a10-9999-d2f0cdc17714_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83869,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_69792de6071260b342a2cbe9778fb8a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb55a90-28b1-5a10-9999-d2f0cdc17714/2eb55a90-28b1-5a10-9999-d2f0cdc17714_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2777870,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_9bf70c3e14545e5f3e105b5e04ede304.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb55a90-28b1-5a10-9999-d2f0cdc17714/2eb55a90-28b1-5a10-9999-d2f0cdc17714_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83463,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/78/9378f23cc1dd5d1a75e37da3bb7c262f/pa/ET54199_b992da882b936913e2f70020e6e60214.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-05-19',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 320d GT xDrive Luxury Line',
'transmission': 'automatic',
'trim': 'xDrive Luxury Line',
'year': 2016}
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET54199%27 HTTP/1.1" 200 None
2026-03-30 11:26:02 [auto1.fr] INFO: Saving data for ET54199: {'created_time': 1774869962.903706, 'last_price_update_time': 1774869962.903714, 'auction_closing_time': 1774972347.0}
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ET54199') HTTP/1.1" 204 0
2026-03-30 11:26:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_570529418fb3258b5111357913d847cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073860d390>
2026-03-30 11:26:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3482567-4d7b-5555-9a1d-b55857ceddf3/e3482567-4d7b-5555-9a1d-b55857ceddf3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff7%252F7ef793803f1cc21d9396bef33f403987%252Fpa%252FPM66643_570529418fb3258b5111357913d847cf.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_570529418fb3258b5111357913d847cf.jpg saved to cache
2026-03-30 11:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e3482567-4d7b-5555-9a1d-b55857ceddf3
2026-03-30 11:26:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_0c03b98f9472f249310e541c386e0276.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383ea810>
2026-03-30 11:26:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3482567-4d7b-5555-9a1d-b55857ceddf3/e3482567-4d7b-5555-9a1d-b55857ceddf3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff7%252F7ef793803f1cc21d9396bef33f403987%252Fpa%252FPM66643_0c03b98f9472f249310e541c386e0276.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_0c03b98f9472f249310e541c386e0276.jpg saved to cache
2026-03-30 11:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e3482567-4d7b-5555-9a1d-b55857ceddf3
2026-03-30 11:26:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_cb965e18e217f925f4af7c7bd6c60c81.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_7012d2259621433b0539f0293d0d4a0f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a7e8190>
2026-03-30 11:26:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3482567-4d7b-5555-9a1d-b55857ceddf3/e3482567-4d7b-5555-9a1d-b55857ceddf3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff7%252F7ef793803f1cc21d9396bef33f403987%252Fpa%252FPM66643_cb965e18e217f925f4af7c7bd6c60c81.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_cb965e18e217f925f4af7c7bd6c60c81.jpg saved to cache
2026-03-30 11:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e3482567-4d7b-5555-9a1d-b55857ceddf3
2026-03-30 11:26:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a7e9e10>
2026-03-30 11:26:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3482567-4d7b-5555-9a1d-b55857ceddf3/e3482567-4d7b-5555-9a1d-b55857ceddf3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff7%252F7ef793803f1cc21d9396bef33f403987%252Fpa%252FPM66643_7012d2259621433b0539f0293d0d4a0f.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_7012d2259621433b0539f0293d0d4a0f.jpg saved to cache
2026-03-30 11:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e3482567-4d7b-5555-9a1d-b55857ceddf3
2026-03-30 11:26:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_f750608710c83b4b5625398252e6de59.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DH43299/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738584850>
2026-03-30 11:26:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3482567-4d7b-5555-9a1d-b55857ceddf3/e3482567-4d7b-5555-9a1d-b55857ceddf3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff7%252F7ef793803f1cc21d9396bef33f403987%252Fpa%252FPM66643_f750608710c83b4b5625398252e6de59.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_f750608710c83b4b5625398252e6de59.jpg saved to cache
2026-03-30 11:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e3482567-4d7b-5555-9a1d-b55857ceddf3
2026-03-30 11:26:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_1fedddaaed0d36d9539902aac14ad57c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_1ec43af44f118106320c762a2750e0f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_b36e06ed80623abb34c43034c50fe405.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384a4bd0>
2026-03-30 11:26:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3482567-4d7b-5555-9a1d-b55857ceddf3/e3482567-4d7b-5555-9a1d-b55857ceddf3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff7%252F7ef793803f1cc21d9396bef33f403987%252Fpa%252FPM66643_1fedddaaed0d36d9539902aac14ad57c.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_1fedddaaed0d36d9539902aac14ad57c.jpg saved to cache
2026-03-30 11:26:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e3482567-4d7b-5555-9a1d-b55857ceddf3
2026-03-30 11:26:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_a8b676b62071a1aaa9db850b68d1f1bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738557c50>
2026-03-30 11:26:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3482567-4d7b-5555-9a1d-b55857ceddf3/e3482567-4d7b-5555-9a1d-b55857ceddf3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff7%252F7ef793803f1cc21d9396bef33f403987%252Fpa%252FPM66643_1ec43af44f118106320c762a2750e0f6.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_1ec43af44f118106320c762a2750e0f6.jpg saved to cache
2026-03-30 11:26:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3482567-4d7b-5555-9a1d-b55857ceddf3
2026-03-30 11:26:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_8bea671b905bb08c34e73ff74d252878.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0739412d10>
2026-03-30 11:26:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3482567-4d7b-5555-9a1d-b55857ceddf3/e3482567-4d7b-5555-9a1d-b55857ceddf3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff7%252F7ef793803f1cc21d9396bef33f403987%252Fpa%252FPM66643_b36e06ed80623abb34c43034c50fe405.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_b36e06ed80623abb34c43034c50fe405.jpg saved to cache
2026-03-30 11:26:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3482567-4d7b-5555-9a1d-b55857ceddf3
2026-03-30 11:26:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738508810>
2026-03-30 11:26:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3482567-4d7b-5555-9a1d-b55857ceddf3/e3482567-4d7b-5555-9a1d-b55857ceddf3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff7%252F7ef793803f1cc21d9396bef33f403987%252Fpa%252FPM66643_a8b676b62071a1aaa9db850b68d1f1bb.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_a8b676b62071a1aaa9db850b68d1f1bb.jpg saved to cache
2026-03-30 11:26:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e3482567-4d7b-5555-9a1d-b55857ceddf3
2026-03-30 11:26:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385dd350>
2026-03-30 11:26:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3482567-4d7b-5555-9a1d-b55857ceddf3/e3482567-4d7b-5555-9a1d-b55857ceddf3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Ff7%252F7ef793803f1cc21d9396bef33f403987%252Fpa%252FPM66643_8bea671b905bb08c34e73ff74d252878.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_8bea671b905bb08c34e73ff74d252878.jpg saved to cache
2026-03-30 11:26:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3482567-4d7b-5555-9a1d-b55857ceddf3
2026-03-30 11:26:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3482567-4d7b-5555-9a1d-b55857ceddf3, skipping ID generation
2026-03-30 11:26:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3482567-4d7b-5555-9a1d-b55857ceddf3 with scrape type 1
2026-03-30 11:26:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3482567-4d7b-5555-9a1d-b55857ceddf3 sending to next pipeline
2026-03-30 11:26:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e3482567-4d7b-5555-9a1d-b55857ceddf3, identifier: PM66643
2026-03-30 11:26:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e3482567-4d7b-5555-9a1d-b55857ceddf3 with identifier: PM66643
2026-03-30 11:26:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e3482567-4d7b-5555-9a1d-b55857ceddf3 with identifier: PM66643
2026-03-30 11:26:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e3482567-4d7b-5555-9a1d-b55857ceddf3 with identifier: PM66643 to the API
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_8bea671b905bb08c34e73ff74d252878.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:30:19Z',
'fuel_type': 'petrol',
'id': 'e3482567-4d7b-5555-9a1d-b55857ceddf3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM66643',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Opel',
'model': 'Agila',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3482567-4d7b-5555-9a1d-b55857ceddf3/e3482567-4d7b-5555-9a1d-b55857ceddf3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_8bea671b905bb08c34e73ff74d252878.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3482567-4d7b-5555-9a1d-b55857ceddf3/e3482567-4d7b-5555-9a1d-b55857ceddf3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_a8b676b62071a1aaa9db850b68d1f1bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3482567-4d7b-5555-9a1d-b55857ceddf3/e3482567-4d7b-5555-9a1d-b55857ceddf3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53510,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_1ec43af44f118106320c762a2750e0f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3482567-4d7b-5555-9a1d-b55857ceddf3/e3482567-4d7b-5555-9a1d-b55857ceddf3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43325,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_b36e06ed80623abb34c43034c50fe405.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3482567-4d7b-5555-9a1d-b55857ceddf3/e3482567-4d7b-5555-9a1d-b55857ceddf3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50000,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_1fedddaaed0d36d9539902aac14ad57c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3482567-4d7b-5555-9a1d-b55857ceddf3/e3482567-4d7b-5555-9a1d-b55857ceddf3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42697,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_f750608710c83b4b5625398252e6de59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3482567-4d7b-5555-9a1d-b55857ceddf3/e3482567-4d7b-5555-9a1d-b55857ceddf3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_7012d2259621433b0539f0293d0d4a0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3482567-4d7b-5555-9a1d-b55857ceddf3/e3482567-4d7b-5555-9a1d-b55857ceddf3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_cb965e18e217f925f4af7c7bd6c60c81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3482567-4d7b-5555-9a1d-b55857ceddf3/e3482567-4d7b-5555-9a1d-b55857ceddf3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73350,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_0c03b98f9472f249310e541c386e0276.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3482567-4d7b-5555-9a1d-b55857ceddf3/e3482567-4d7b-5555-9a1d-b55857ceddf3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63509,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/f7/7ef793803f1cc21d9396bef33f403987/pa/PM66643_570529418fb3258b5111357913d847cf.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-09-21',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Agila 1.2 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2014}
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM66643%27 HTTP/1.1" 200 None
2026-03-30 11:26:04 [auto1.fr] INFO: Saving data for PM66643: {'created_time': 1774869964.811042, 'last_price_update_time': 1774869964.811056, 'auction_closing_time': 1774971019.0}
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PM66643') HTTP/1.1" 204 0
2026-03-30 11:26:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MC54002/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:05 [scrapy.extensions.logstats] INFO: Crawled 227 pages (at 16 pages/min), scraped 180 items (at 13 items/min)
2026-03-30 11:26:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:26:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TP56731/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LE79705> (referer: https://www.auto1.com/v1/car-details-view/LE79705/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c0751ed-adeb-52d0-8e10-140ece108cc2 with identifier: LE79705
2026-03-30 11:26:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c0751ed-adeb-52d0-8e10-140ece108cc2 with scrape type 1
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8c0751ed-adeb-52d0-8e10-140ece108cc2
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F96%252F78962c4edf4ff68bb231851c782c81c3%252Fpa%252FLE79705_b75f9426da523f954089e8d3a0bd84a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_b75f9426da523f954089e8d3a0bd84a1.jpg not downloaded yet
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F96%252F78962c4edf4ff68bb231851c782c81c3%252Fpa%252FLE79705_9d5c417ac34d8442121a7b2c2ba0d4df.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_9d5c417ac34d8442121a7b2c2ba0d4df.jpg not downloaded yet
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F96%252F78962c4edf4ff68bb231851c782c81c3%252Fpa%252FLE79705_ebbb5ca1b28f80f876247d4532d5b52b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_ebbb5ca1b28f80f876247d4532d5b52b.jpg not downloaded yet
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F96%252F78962c4edf4ff68bb231851c782c81c3%252Fpa%252FLE79705_6f21d95501f359323dfed7c556e58c78.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_6f21d95501f359323dfed7c556e58c78.jpg not downloaded yet
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F96%252F78962c4edf4ff68bb231851c782c81c3%252Fpa%252FLE79705_6449713aa07af778c3262b7dc4e874fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_6449713aa07af778c3262b7dc4e874fc.jpg not downloaded yet
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F96%252F78962c4edf4ff68bb231851c782c81c3%252Fpa%252FLE79705_bbbca7fecbb7a7f36cc7f5ec21fa5f07.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_bbbca7fecbb7a7f36cc7f5ec21fa5f07.jpg not downloaded yet
2026-03-30 11:26:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JF13819> (referer: https://www.auto1.com/v1/car-details-view/JF13819/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3c8963f-0f4e-5606-b3bc-65341187b5c1 with identifier: JF13819
2026-03-30 11:26:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c8963f-0f4e-5606-b3bc-65341187b5c1 with scrape type 1
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b3c8963f-0f4e-5606-b3bc-65341187b5c1
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fc0%252F2ec02f21385a27ae5b2af1d123ae689b%252Fpa%252FJF13819_da68baec8c47589c90dfdf62b1a44be9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_da68baec8c47589c90dfdf62b1a44be9.jpg not downloaded yet
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fc0%252F2ec02f21385a27ae5b2af1d123ae689b%252Fpa%252FJF13819_2ff37984fd32d5dea6eedcc8193fad80.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_2ff37984fd32d5dea6eedcc8193fad80.jpg not downloaded yet
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fc0%252F2ec02f21385a27ae5b2af1d123ae689b%252Fpa%252FJF13819_e2823f571c860c5b5af2619416f6888e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_e2823f571c860c5b5af2619416f6888e.jpg not downloaded yet
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fc0%252F2ec02f21385a27ae5b2af1d123ae689b%252Fpa%252FJF13819_a5426021b013abd576b3a80ea1908551.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_a5426021b013abd576b3a80ea1908551.jpg not downloaded yet
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fc0%252F2ec02f21385a27ae5b2af1d123ae689b%252Fpa%252FJF13819_c7393b8399ed90bb1333cfdb80ceadc5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_c7393b8399ed90bb1333cfdb80ceadc5.jpg not downloaded yet
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fc0%252F2ec02f21385a27ae5b2af1d123ae689b%252Fpa%252FJF13819_388a8264d8753da693c1ebc716f22b34.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_388a8264d8753da693c1ebc716f22b34.jpg not downloaded yet
2026-03-30 11:26:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_bbbca7fecbb7a7f36cc7f5ec21fa5f07.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fc0%252F2ec02f21385a27ae5b2af1d123ae689b%252Fpa%252FJF13819_f85fc45d80c0e307de8929bc841ab141.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_f85fc45d80c0e307de8929bc841ab141.jpg not downloaded yet
2026-03-30 11:26:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KB70829/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fc0%252F2ec02f21385a27ae5b2af1d123ae689b%252Fpa%252FJF13819_7734633298baf8449ffe79a5846c0723.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_7734633298baf8449ffe79a5846c0723.jpg not downloaded yet
2026-03-30 11:26:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fc0%252F2ec02f21385a27ae5b2af1d123ae689b%252Fpa%252FJF13819_7f42b22036ee78589c22161b0c6be966.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_7f42b22036ee78589c22161b0c6be966.jpg not downloaded yet
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fc0%252F2ec02f21385a27ae5b2af1d123ae689b%252Fpa%252FJF13819_04c9d48821f193f913760193eda7ca1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_04c9d48821f193f913760193eda7ca1e.jpg not downloaded yet
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738560dd0>
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c0751ed-adeb-52d0-8e10-140ece108cc2/8c0751ed-adeb-52d0-8e10-140ece108cc2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F96%252F78962c4edf4ff68bb231851c782c81c3%252Fpa%252FLE79705_bbbca7fecbb7a7f36cc7f5ec21fa5f07.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_bbbca7fecbb7a7f36cc7f5ec21fa5f07.jpg saved to cache
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c0751ed-adeb-52d0-8e10-140ece108cc2
2026-03-30 11:26:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_f85fc45d80c0e307de8929bc841ab141.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_388a8264d8753da693c1ebc716f22b34.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_04c9d48821f193f913760193eda7ca1e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384a4e90>
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c8963f-0f4e-5606-b3bc-65341187b5c1/b3c8963f-0f4e-5606-b3bc-65341187b5c1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fc0%252F2ec02f21385a27ae5b2af1d123ae689b%252Fpa%252FJF13819_f85fc45d80c0e307de8929bc841ab141.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_f85fc45d80c0e307de8929bc841ab141.jpg saved to cache
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3c8963f-0f4e-5606-b3bc-65341187b5c1
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383f0f50>
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c8963f-0f4e-5606-b3bc-65341187b5c1/b3c8963f-0f4e-5606-b3bc-65341187b5c1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fc0%252F2ec02f21385a27ae5b2af1d123ae689b%252Fpa%252FJF13819_388a8264d8753da693c1ebc716f22b34.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_388a8264d8753da693c1ebc716f22b34.jpg saved to cache
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3c8963f-0f4e-5606-b3bc-65341187b5c1
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073868c810>
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c8963f-0f4e-5606-b3bc-65341187b5c1/b3c8963f-0f4e-5606-b3bc-65341187b5c1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fc0%252F2ec02f21385a27ae5b2af1d123ae689b%252Fpa%252FJF13819_04c9d48821f193f913760193eda7ca1e.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_04c9d48821f193f913760193eda7ca1e.jpg saved to cache
2026-03-30 11:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b3c8963f-0f4e-5606-b3bc-65341187b5c1
2026-03-30 11:26:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_7f42b22036ee78589c22161b0c6be966.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738508d90>
2026-03-30 11:26:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c8963f-0f4e-5606-b3bc-65341187b5c1/b3c8963f-0f4e-5606-b3bc-65341187b5c1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fc0%252F2ec02f21385a27ae5b2af1d123ae689b%252Fpa%252FJF13819_7f42b22036ee78589c22161b0c6be966.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_7f42b22036ee78589c22161b0c6be966.jpg saved to cache
2026-03-30 11:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b3c8963f-0f4e-5606-b3bc-65341187b5c1
2026-03-30 11:26:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GD81242/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_7734633298baf8449ffe79a5846c0723.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS22176> (referer: https://www.auto1.com/v1/car-details-view/JS22176/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073875ddd0>
2026-03-30 11:26:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c8963f-0f4e-5606-b3bc-65341187b5c1/b3c8963f-0f4e-5606-b3bc-65341187b5c1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fc0%252F2ec02f21385a27ae5b2af1d123ae689b%252Fpa%252FJF13819_7734633298baf8449ffe79a5846c0723.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_7734633298baf8449ffe79a5846c0723.jpg saved to cache
2026-03-30 11:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3c8963f-0f4e-5606-b3bc-65341187b5c1
2026-03-30 11:26:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_c7393b8399ed90bb1333cfdb80ceadc5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68f8cf2f-a50f-53dd-978a-52bf0d924142 with identifier: JS22176
2026-03-30 11:26:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68f8cf2f-a50f-53dd-978a-52bf0d924142 with scrape type 1
2026-03-30 11:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 68f8cf2f-a50f-53dd-978a-52bf0d924142
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d45b6e693ec284ba7ac7cefa8c378%252Fpa%252FJS22176_d04d17f3e11a3706f3e2464aed9ba185.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_d04d17f3e11a3706f3e2464aed9ba185.jpg already downloaded
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d45b6e693ec284ba7ac7cefa8c378%252Fpa%252FJS22176_c5ea9daa5c03ebae43a7d3961a59e8a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_c5ea9daa5c03ebae43a7d3961a59e8a0.jpg already downloaded
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d45b6e693ec284ba7ac7cefa8c378%252Fpa%252FJS22176_140ee32dcfb83fe1c0e2b3f42783b069.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_140ee32dcfb83fe1c0e2b3f42783b069.jpg already downloaded
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d45b6e693ec284ba7ac7cefa8c378%252Fpa%252FJS22176_c01efc1aadb0aae80cadd5df6e2158f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_c01efc1aadb0aae80cadd5df6e2158f8.jpg already downloaded
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d45b6e693ec284ba7ac7cefa8c378%252Fpa%252FJS22176_fd0769e691da442bbff4cce13285b0a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_fd0769e691da442bbff4cce13285b0a2.jpg already downloaded
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d45b6e693ec284ba7ac7cefa8c378%252Fpa%252FJS22176_7ca2a34a800780f1d70820c46ce15349.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_7ca2a34a800780f1d70820c46ce15349.jpg already downloaded
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d45b6e693ec284ba7ac7cefa8c378%252Fpa%252FJS22176_a432021d81c8868936d47abb14a4f767.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_a432021d81c8868936d47abb14a4f767.jpg already downloaded
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d45b6e693ec284ba7ac7cefa8c378%252Fpa%252FJS22176_203249586790ea9ad08d4266a608aba6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_203249586790ea9ad08d4266a608aba6.jpg already downloaded
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d45b6e693ec284ba7ac7cefa8c378%252Fpa%252FJS22176_920bbed2d37fbaf8e01026d0b87665b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_920bbed2d37fbaf8e01026d0b87665b1.jpg already downloaded
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d45b6e693ec284ba7ac7cefa8c378%252Fpa%252FJS22176_571a7926e4db694c6bf80c226ef5ce1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_571a7926e4db694c6bf80c226ef5ce1b.jpg already downloaded
2026-03-30 11:26:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 68f8cf2f-a50f-53dd-978a-52bf0d924142, identifier: JS22176
2026-03-30 11:26:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 68f8cf2f-a50f-53dd-978a-52bf0d924142 with identifier: JS22176
2026-03-30 11:26:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 68f8cf2f-a50f-53dd-978a-52bf0d924142 with identifier: JS22176
2026-03-30 11:26:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 68f8cf2f-a50f-53dd-978a-52bf0d924142 with identifier: JS22176 to the API
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JS22176>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': 'Taxi',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 165,
'expiration_date': '2026-03-31T15:03:14Z',
'fuel_type': 'petrol',
'id': '68f8cf2f-a50f-53dd-978a-52bf0d924142',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS22176',
'listing': 'auction',
'location': 'FR, Quincieux',
'make': 'Peugeot',
'model': '3008',
'odometer': 118284,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_d04d17f3e11a3706f3e2464aed9ba185.jpg',
'https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_c5ea9daa5c03ebae43a7d3961a59e8a0.jpg',
'https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_140ee32dcfb83fe1c0e2b3f42783b069.jpg',
'https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_c01efc1aadb0aae80cadd5df6e2158f8.jpg',
'https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_fd0769e691da442bbff4cce13285b0a2.jpg',
'https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_7ca2a34a800780f1d70820c46ce15349.jpg',
'https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_a432021d81c8868936d47abb14a4f767.jpg',
'https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_203249586790ea9ad08d4266a608aba6.jpg',
'https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_920bbed2d37fbaf8e01026d0b87665b1.jpg',
'https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_571a7926e4db694c6bf80c226ef5ce1b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68f8cf2f-a50f-53dd-978a-52bf0d924142/68f8cf2f-a50f-53dd-978a-52bf0d924142_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57335,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_d04d17f3e11a3706f3e2464aed9ba185.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68f8cf2f-a50f-53dd-978a-52bf0d924142/68f8cf2f-a50f-53dd-978a-52bf0d924142_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322070,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_c5ea9daa5c03ebae43a7d3961a59e8a0.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68f8cf2f-a50f-53dd-978a-52bf0d924142/68f8cf2f-a50f-53dd-978a-52bf0d924142_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59599,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_140ee32dcfb83fe1c0e2b3f42783b069.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68f8cf2f-a50f-53dd-978a-52bf0d924142/68f8cf2f-a50f-53dd-978a-52bf0d924142_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 266880,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_c01efc1aadb0aae80cadd5df6e2158f8.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68f8cf2f-a50f-53dd-978a-52bf0d924142/68f8cf2f-a50f-53dd-978a-52bf0d924142_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300160,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_fd0769e691da442bbff4cce13285b0a2.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68f8cf2f-a50f-53dd-978a-52bf0d924142/68f8cf2f-a50f-53dd-978a-52bf0d924142_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343642,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_7ca2a34a800780f1d70820c46ce15349.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68f8cf2f-a50f-53dd-978a-52bf0d924142/68f8cf2f-a50f-53dd-978a-52bf0d924142_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48496,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_a432021d81c8868936d47abb14a4f767.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68f8cf2f-a50f-53dd-978a-52bf0d924142/68f8cf2f-a50f-53dd-978a-52bf0d924142_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322845,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_203249586790ea9ad08d4266a608aba6.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68f8cf2f-a50f-53dd-978a-52bf0d924142/68f8cf2f-a50f-53dd-978a-52bf0d924142_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54928,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_920bbed2d37fbaf8e01026d0b87665b1.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68f8cf2f-a50f-53dd-978a-52bf0d924142/68f8cf2f-a50f-53dd-978a-52bf0d924142_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42909,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img6b/1d/6b1d45b6e693ec284ba7ac7cefa8c378/pa/JS22176_571a7926e4db694c6bf80c226ef5ce1b.jpg',
'Width': 640}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-23',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 THP GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2018}
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JS22176%27 HTTP/1.1" 200 None
2026-03-30 11:26:14 [auto1.fr] INFO: Saving data for JS22176: {'created_time': 1774869974.055506, 'last_price_update_time': 1774869974.055518, 'auction_closing_time': 1774969394.0}
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JS22176') HTTP/1.1" 204 0
2026-03-30 11:26:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_a5426021b013abd576b3a80ea1908551.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_e2823f571c860c5b5af2619416f6888e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UC03940/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MV42781/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738465250>
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c8963f-0f4e-5606-b3bc-65341187b5c1/b3c8963f-0f4e-5606-b3bc-65341187b5c1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fc0%252F2ec02f21385a27ae5b2af1d123ae689b%252Fpa%252FJF13819_c7393b8399ed90bb1333cfdb80ceadc5.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_c7393b8399ed90bb1333cfdb80ceadc5.jpg saved to cache
2026-03-30 11:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3c8963f-0f4e-5606-b3bc-65341187b5c1
2026-03-30 11:26:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_2ff37984fd32d5dea6eedcc8193fad80.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383d0bd0>
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c8963f-0f4e-5606-b3bc-65341187b5c1/b3c8963f-0f4e-5606-b3bc-65341187b5c1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fc0%252F2ec02f21385a27ae5b2af1d123ae689b%252Fpa%252FJF13819_a5426021b013abd576b3a80ea1908551.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_a5426021b013abd576b3a80ea1908551.jpg saved to cache
2026-03-30 11:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3c8963f-0f4e-5606-b3bc-65341187b5c1
2026-03-30 11:26:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_da68baec8c47589c90dfdf62b1a44be9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_6449713aa07af778c3262b7dc4e874fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a7e3b50>
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c8963f-0f4e-5606-b3bc-65341187b5c1/b3c8963f-0f4e-5606-b3bc-65341187b5c1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fc0%252F2ec02f21385a27ae5b2af1d123ae689b%252Fpa%252FJF13819_e2823f571c860c5b5af2619416f6888e.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_e2823f571c860c5b5af2619416f6888e.jpg saved to cache
2026-03-30 11:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3c8963f-0f4e-5606-b3bc-65341187b5c1
2026-03-30 11:26:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_ebbb5ca1b28f80f876247d4532d5b52b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384b3750>
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c8963f-0f4e-5606-b3bc-65341187b5c1/b3c8963f-0f4e-5606-b3bc-65341187b5c1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fc0%252F2ec02f21385a27ae5b2af1d123ae689b%252Fpa%252FJF13819_2ff37984fd32d5dea6eedcc8193fad80.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_2ff37984fd32d5dea6eedcc8193fad80.jpg saved to cache
2026-03-30 11:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3c8963f-0f4e-5606-b3bc-65341187b5c1
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738668910>
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c8963f-0f4e-5606-b3bc-65341187b5c1/b3c8963f-0f4e-5606-b3bc-65341187b5c1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fc0%252F2ec02f21385a27ae5b2af1d123ae689b%252Fpa%252FJF13819_da68baec8c47589c90dfdf62b1a44be9.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_da68baec8c47589c90dfdf62b1a44be9.jpg saved to cache
2026-03-30 11:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3c8963f-0f4e-5606-b3bc-65341187b5c1
2026-03-30 11:26:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3c8963f-0f4e-5606-b3bc-65341187b5c1, skipping ID generation
2026-03-30 11:26:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c8963f-0f4e-5606-b3bc-65341187b5c1 with scrape type 1
2026-03-30 11:26:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3c8963f-0f4e-5606-b3bc-65341187b5c1 sending to next pipeline
2026-03-30 11:26:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b3c8963f-0f4e-5606-b3bc-65341187b5c1, identifier: JF13819
2026-03-30 11:26:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b3c8963f-0f4e-5606-b3bc-65341187b5c1 with identifier: JF13819
2026-03-30 11:26:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b3c8963f-0f4e-5606-b3bc-65341187b5c1 with identifier: JF13819
2026-03-30 11:26:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b3c8963f-0f4e-5606-b3bc-65341187b5c1 with identifier: JF13819 to the API
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_da68baec8c47589c90dfdf62b1a44be9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:12:00Z',
'fuel_type': 'diesel',
'id': 'b3c8963f-0f4e-5606-b3bc-65341187b5c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF13819',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'BMW',
'model': 'X1',
'odometer': 151016,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c8963f-0f4e-5606-b3bc-65341187b5c1/b3c8963f-0f4e-5606-b3bc-65341187b5c1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_da68baec8c47589c90dfdf62b1a44be9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c8963f-0f4e-5606-b3bc-65341187b5c1/b3c8963f-0f4e-5606-b3bc-65341187b5c1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_2ff37984fd32d5dea6eedcc8193fad80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c8963f-0f4e-5606-b3bc-65341187b5c1/b3c8963f-0f4e-5606-b3bc-65341187b5c1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65368,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_e2823f571c860c5b5af2619416f6888e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c8963f-0f4e-5606-b3bc-65341187b5c1/b3c8963f-0f4e-5606-b3bc-65341187b5c1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61266,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_a5426021b013abd576b3a80ea1908551.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c8963f-0f4e-5606-b3bc-65341187b5c1/b3c8963f-0f4e-5606-b3bc-65341187b5c1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96270,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_c7393b8399ed90bb1333cfdb80ceadc5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c8963f-0f4e-5606-b3bc-65341187b5c1/b3c8963f-0f4e-5606-b3bc-65341187b5c1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_388a8264d8753da693c1ebc716f22b34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c8963f-0f4e-5606-b3bc-65341187b5c1/b3c8963f-0f4e-5606-b3bc-65341187b5c1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51174,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_f85fc45d80c0e307de8929bc841ab141.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c8963f-0f4e-5606-b3bc-65341187b5c1/b3c8963f-0f4e-5606-b3bc-65341187b5c1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114702,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_7734633298baf8449ffe79a5846c0723.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c8963f-0f4e-5606-b3bc-65341187b5c1/b3c8963f-0f4e-5606-b3bc-65341187b5c1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_7f42b22036ee78589c22161b0c6be966.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c8963f-0f4e-5606-b3bc-65341187b5c1/b3c8963f-0f4e-5606-b3bc-65341187b5c1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84173,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/c0/2ec02f21385a27ae5b2af1d123ae689b/pa/JF13819_04c9d48821f193f913760193eda7ca1e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-08-06',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 sDrive 18d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2017}
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF13819%27 HTTP/1.1" 200 None
2026-03-30 11:26:14 [auto1.fr] INFO: Saving data for JF13819: {'created_time': 1774869974.884934, 'last_price_update_time': 1774869974.884947, 'auction_closing_time': 1774969920.0}
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JF13819') HTTP/1.1" 204 0
2026-03-30 11:26:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_b75f9426da523f954089e8d3a0bd84a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0739412610>
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c0751ed-adeb-52d0-8e10-140ece108cc2/8c0751ed-adeb-52d0-8e10-140ece108cc2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F96%252F78962c4edf4ff68bb231851c782c81c3%252Fpa%252FLE79705_6449713aa07af778c3262b7dc4e874fc.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_6449713aa07af778c3262b7dc4e874fc.jpg saved to cache
2026-03-30 11:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c0751ed-adeb-52d0-8e10-140ece108cc2
2026-03-30 11:26:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_9d5c417ac34d8442121a7b2c2ba0d4df.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384d5910>
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c0751ed-adeb-52d0-8e10-140ece108cc2/8c0751ed-adeb-52d0-8e10-140ece108cc2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F96%252F78962c4edf4ff68bb231851c782c81c3%252Fpa%252FLE79705_ebbb5ca1b28f80f876247d4532d5b52b.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_ebbb5ca1b28f80f876247d4532d5b52b.jpg saved to cache
2026-03-30 11:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c0751ed-adeb-52d0-8e10-140ece108cc2
2026-03-30 11:26:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383b35d0>
2026-03-30 11:26:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c0751ed-adeb-52d0-8e10-140ece108cc2/8c0751ed-adeb-52d0-8e10-140ece108cc2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F96%252F78962c4edf4ff68bb231851c782c81c3%252Fpa%252FLE79705_b75f9426da523f954089e8d3a0bd84a1.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_b75f9426da523f954089e8d3a0bd84a1.jpg saved to cache
2026-03-30 11:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c0751ed-adeb-52d0-8e10-140ece108cc2
2026-03-30 11:26:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_6f21d95501f359323dfed7c556e58c78.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738722b10>
2026-03-30 11:26:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c0751ed-adeb-52d0-8e10-140ece108cc2/8c0751ed-adeb-52d0-8e10-140ece108cc2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F96%252F78962c4edf4ff68bb231851c782c81c3%252Fpa%252FLE79705_9d5c417ac34d8442121a7b2c2ba0d4df.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_9d5c417ac34d8442121a7b2c2ba0d4df.jpg saved to cache
2026-03-30 11:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c0751ed-adeb-52d0-8e10-140ece108cc2
2026-03-30 11:26:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385d7110>
2026-03-30 11:26:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c0751ed-adeb-52d0-8e10-140ece108cc2/8c0751ed-adeb-52d0-8e10-140ece108cc2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F96%252F78962c4edf4ff68bb231851c782c81c3%252Fpa%252FLE79705_6f21d95501f359323dfed7c556e58c78.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_6f21d95501f359323dfed7c556e58c78.jpg saved to cache
2026-03-30 11:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c0751ed-adeb-52d0-8e10-140ece108cc2
2026-03-30 11:26:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c0751ed-adeb-52d0-8e10-140ece108cc2, skipping ID generation
2026-03-30 11:26:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c0751ed-adeb-52d0-8e10-140ece108cc2 with scrape type 1
2026-03-30 11:26:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c0751ed-adeb-52d0-8e10-140ece108cc2 sending to next pipeline
2026-03-30 11:26:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8c0751ed-adeb-52d0-8e10-140ece108cc2, identifier: LE79705
2026-03-30 11:26:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8c0751ed-adeb-52d0-8e10-140ece108cc2 with identifier: LE79705
2026-03-30 11:26:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8c0751ed-adeb-52d0-8e10-140ece108cc2 with identifier: LE79705
2026-03-30 11:26:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8c0751ed-adeb-52d0-8e10-140ece108cc2 with identifier: LE79705 to the API
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_6f21d95501f359323dfed7c556e58c78.jpg>
{'auction_title': '',
'c_o_2_emission_value': 180,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 3',
'engine': '1.8L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:21:57Z',
'fuel_type': 'petrol',
'id': '8c0751ed-adeb-52d0-8e10-140ece108cc2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE79705',
'listing': 'auction',
'location': 'FR, Dax',
'make': 'Renault',
'model': 'Megane',
'odometer': 122928,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0751ed-adeb-52d0-8e10-140ece108cc2/8c0751ed-adeb-52d0-8e10-140ece108cc2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95006,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_b75f9426da523f954089e8d3a0bd84a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0751ed-adeb-52d0-8e10-140ece108cc2/8c0751ed-adeb-52d0-8e10-140ece108cc2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103089,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_9d5c417ac34d8442121a7b2c2ba0d4df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0751ed-adeb-52d0-8e10-140ece108cc2/8c0751ed-adeb-52d0-8e10-140ece108cc2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_ebbb5ca1b28f80f876247d4532d5b52b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0751ed-adeb-52d0-8e10-140ece108cc2/8c0751ed-adeb-52d0-8e10-140ece108cc2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80563,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_6f21d95501f359323dfed7c556e58c78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0751ed-adeb-52d0-8e10-140ece108cc2/8c0751ed-adeb-52d0-8e10-140ece108cc2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_6449713aa07af778c3262b7dc4e874fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c0751ed-adeb-52d0-8e10-140ece108cc2/8c0751ed-adeb-52d0-8e10-140ece108cc2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39154,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/96/78962c4edf4ff68bb231851c782c81c3/pa/LE79705_bbbca7fecbb7a7f36cc7f5ec21fa5f07.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2001-07-22',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.8 Privilege',
'transmission': 'manual',
'trim': 'Privilege',
'year': 2001}
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LE79705%27 HTTP/1.1" 200 None
2026-03-30 11:26:15 [auto1.fr] INFO: Saving data for LE79705: {'created_time': 1774869975.723271, 'last_price_update_time': 1774869975.72328, 'auction_closing_time': 1774970517.0}
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LE79705') HTTP/1.1" 204 0
2026-03-30 11:26:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA06834/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RH39246/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TP56731> (referer: https://www.auto1.com/v1/car-details-view/TP56731/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57101894-e059-545b-9705-a121728eb2af with identifier: TP56731
2026-03-30 11:26:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57101894-e059-545b-9705-a121728eb2af with scrape type 1
2026-03-30 11:26:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 57101894-e059-545b-9705-a121728eb2af
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8f%252Ff58f3744df01e485855cee7851fe0503%252Fpa%252FTP56731_2bf028f2bfd297e4aae4fbfa59cc1bd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_2bf028f2bfd297e4aae4fbfa59cc1bd5.jpg already downloaded
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8f%252Ff58f3744df01e485855cee7851fe0503%252Fpa%252FTP56731_9b1521623e5399dd36d87da8e2e25a14.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_9b1521623e5399dd36d87da8e2e25a14.jpg already downloaded
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8f%252Ff58f3744df01e485855cee7851fe0503%252Fpa%252FTP56731_8e6fbd9e1fac90367a7fe90e1d86672a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_8e6fbd9e1fac90367a7fe90e1d86672a.jpg already downloaded
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8f%252Ff58f3744df01e485855cee7851fe0503%252Fpa%252FTP56731_3980d4651c9d8c0812b9592b20dc0cf0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_3980d4651c9d8c0812b9592b20dc0cf0.jpg already downloaded
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8f%252Ff58f3744df01e485855cee7851fe0503%252Fpa%252FTP56731_88153f627104efadfb9846f513ae8e0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_88153f627104efadfb9846f513ae8e0c.jpg already downloaded
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8f%252Ff58f3744df01e485855cee7851fe0503%252Fpa%252FTP56731_2ebf56c275d44e451a6b906608b4651d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_2ebf56c275d44e451a6b906608b4651d.jpg already downloaded
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8f%252Ff58f3744df01e485855cee7851fe0503%252Fpa%252FTP56731_4e1706c53af2372fbce26bb7dcdfc48d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_4e1706c53af2372fbce26bb7dcdfc48d.jpg already downloaded
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8f%252Ff58f3744df01e485855cee7851fe0503%252Fpa%252FTP56731_26f44f22985e2c84ac219fcd4dc4d382.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_26f44f22985e2c84ac219fcd4dc4d382.jpg already downloaded
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8f%252Ff58f3744df01e485855cee7851fe0503%252Fpa%252FTP56731_debe7cb5254b9e2b46fe71bb0fb7b54d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_debe7cb5254b9e2b46fe71bb0fb7b54d.jpg already downloaded
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F8f%252Ff58f3744df01e485855cee7851fe0503%252Fpa%252FTP56731_37e17a857f72f436ed26b8f78f284500.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_37e17a857f72f436ed26b8f78f284500.jpg already downloaded
2026-03-30 11:26:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 57101894-e059-545b-9705-a121728eb2af, identifier: TP56731
2026-03-30 11:26:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 57101894-e059-545b-9705-a121728eb2af with identifier: TP56731
2026-03-30 11:26:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 57101894-e059-545b-9705-a121728eb2af with identifier: TP56731
2026-03-30 11:26:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 57101894-e059-545b-9705-a121728eb2af with identifier: TP56731 to the API
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TP56731>
{'auction_title': '',
'c_o_2_emission_value': 156,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 177,
'expiration_date': '2026-03-31T15:58:25Z',
'fuel_type': 'diesel',
'id': '57101894-e059-545b-9705-a121728eb2af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP56731',
'listing': 'auction',
'location': 'FR, Nanteuil-le-Haudouin',
'make': 'Audi',
'model': 'A4 Allroad',
'odometer': 130191,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photo_urls': ['https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_2bf028f2bfd297e4aae4fbfa59cc1bd5.jpg',
'https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_9b1521623e5399dd36d87da8e2e25a14.jpg',
'https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_8e6fbd9e1fac90367a7fe90e1d86672a.jpg',
'https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_3980d4651c9d8c0812b9592b20dc0cf0.jpg',
'https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_88153f627104efadfb9846f513ae8e0c.jpg',
'https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_2ebf56c275d44e451a6b906608b4651d.jpg',
'https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_4e1706c53af2372fbce26bb7dcdfc48d.jpg',
'https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_26f44f22985e2c84ac219fcd4dc4d382.jpg',
'https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_debe7cb5254b9e2b46fe71bb0fb7b54d.jpg',
'https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_37e17a857f72f436ed26b8f78f284500.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57101894-e059-545b-9705-a121728eb2af/57101894-e059-545b-9705-a121728eb2af_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71167,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_2bf028f2bfd297e4aae4fbfa59cc1bd5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57101894-e059-545b-9705-a121728eb2af/57101894-e059-545b-9705-a121728eb2af_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71701,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_9b1521623e5399dd36d87da8e2e25a14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57101894-e059-545b-9705-a121728eb2af/57101894-e059-545b-9705-a121728eb2af_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66760,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_8e6fbd9e1fac90367a7fe90e1d86672a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57101894-e059-545b-9705-a121728eb2af/57101894-e059-545b-9705-a121728eb2af_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62784,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_3980d4651c9d8c0812b9592b20dc0cf0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57101894-e059-545b-9705-a121728eb2af/57101894-e059-545b-9705-a121728eb2af_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60953,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_88153f627104efadfb9846f513ae8e0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57101894-e059-545b-9705-a121728eb2af/57101894-e059-545b-9705-a121728eb2af_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64726,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_2ebf56c275d44e451a6b906608b4651d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57101894-e059-545b-9705-a121728eb2af/57101894-e059-545b-9705-a121728eb2af_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65118,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_4e1706c53af2372fbce26bb7dcdfc48d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57101894-e059-545b-9705-a121728eb2af/57101894-e059-545b-9705-a121728eb2af_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65028,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_26f44f22985e2c84ac219fcd4dc4d382.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57101894-e059-545b-9705-a121728eb2af/57101894-e059-545b-9705-a121728eb2af_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69811,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_debe7cb5254b9e2b46fe71bb0fb7b54d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57101894-e059-545b-9705-a121728eb2af/57101894-e059-545b-9705-a121728eb2af_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69087,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/8f/f58f3744df01e485855cee7851fe0503/pa/TP56731_37e17a857f72f436ed26b8f78f284500.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-06-17',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 Allroad 2.0 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-30 11:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP56731%27 HTTP/1.1" 200 None
2026-03-30 11:26:18 [auto1.fr] INFO: Saving data for TP56731: {'created_time': 1774869978.010858, 'last_price_update_time': 1774869978.010868, 'auction_closing_time': 1774972705.0}
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TP56731') HTTP/1.1" 204 0
2026-03-30 11:26:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LJ73279/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GD81242> (referer: https://www.auto1.com/v1/car-details-view/GD81242/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dbc84b8-30a1-58d1-a57f-74f7c5143ce9 with identifier: GD81242
2026-03-30 11:26:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dbc84b8-30a1-58d1-a57f-74f7c5143ce9 with scrape type 1
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1dbc84b8-30a1-58d1-a57f-74f7c5143ce9
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fa2%252Ff3a21b06dc648af4c649f5cfd360a224%252Fpa%252FGD81242_4bc914fcbce612742dc20a00e4954480.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_4bc914fcbce612742dc20a00e4954480.jpg already downloaded
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fa2%252Ff3a21b06dc648af4c649f5cfd360a224%252Fpa%252FGD81242_372575d9294c20ec930e042fc859fc10.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_372575d9294c20ec930e042fc859fc10.jpg already downloaded
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fa2%252Ff3a21b06dc648af4c649f5cfd360a224%252Fpa%252FGD81242_66573fb077265b478b0a68ed7a1e5dbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_66573fb077265b478b0a68ed7a1e5dbc.jpg already downloaded
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fa2%252Ff3a21b06dc648af4c649f5cfd360a224%252Fpa%252FGD81242_7c7359d8c565c6769583ce34eb853aef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_7c7359d8c565c6769583ce34eb853aef.jpg already downloaded
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fa2%252Ff3a21b06dc648af4c649f5cfd360a224%252Fpa%252FGD81242_45619287a0d94e5dea083f1e1bcc59ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_45619287a0d94e5dea083f1e1bcc59ec.jpg already downloaded
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fa2%252Ff3a21b06dc648af4c649f5cfd360a224%252Fpa%252FGD81242_d84094d0b1e43af5ed76c5482f8c5ec1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_d84094d0b1e43af5ed76c5482f8c5ec1.jpg already downloaded
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fa2%252Ff3a21b06dc648af4c649f5cfd360a224%252Fpa%252FGD81242_3aef1e8c286b6fabe559b154203574fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_3aef1e8c286b6fabe559b154203574fe.jpg already downloaded
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fa2%252Ff3a21b06dc648af4c649f5cfd360a224%252Fpa%252FGD81242_48924bfcc833458b6fdf53a020cd4948.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_48924bfcc833458b6fdf53a020cd4948.jpg already downloaded
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fa2%252Ff3a21b06dc648af4c649f5cfd360a224%252Fpa%252FGD81242_0ea5352c6c299a31a981fc1fb724a95c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_0ea5352c6c299a31a981fc1fb724a95c.jpg already downloaded
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fa2%252Ff3a21b06dc648af4c649f5cfd360a224%252Fpa%252FGD81242_e134b0fddd3b473ec74019250b65994e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_e134b0fddd3b473ec74019250b65994e.jpg already downloaded
2026-03-30 11:26:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1dbc84b8-30a1-58d1-a57f-74f7c5143ce9, identifier: GD81242
2026-03-30 11:26:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1dbc84b8-30a1-58d1-a57f-74f7c5143ce9 with identifier: GD81242
2026-03-30 11:26:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1dbc84b8-30a1-58d1-a57f-74f7c5143ce9 with identifier: GD81242
2026-03-30 11:26:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1dbc84b8-30a1-58d1-a57f-74f7c5143ce9 with identifier: GD81242 to the API
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GD81242>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-03-31T15:13:11Z',
'fuel_type': 'diesel',
'id': '1dbc84b8-30a1-58d1-a57f-74f7c5143ce9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD81242',
'listing': 'auction',
'location': 'FR, Tarnos',
'make': 'BMW',
'model': '3er',
'odometer': 230452,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_4bc914fcbce612742dc20a00e4954480.jpg',
'https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_372575d9294c20ec930e042fc859fc10.jpg',
'https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_66573fb077265b478b0a68ed7a1e5dbc.jpg',
'https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_7c7359d8c565c6769583ce34eb853aef.jpg',
'https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_45619287a0d94e5dea083f1e1bcc59ec.jpg',
'https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_d84094d0b1e43af5ed76c5482f8c5ec1.jpg',
'https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_3aef1e8c286b6fabe559b154203574fe.jpg',
'https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_48924bfcc833458b6fdf53a020cd4948.jpg',
'https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_0ea5352c6c299a31a981fc1fb724a95c.jpg',
'https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_e134b0fddd3b473ec74019250b65994e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbc84b8-30a1-58d1-a57f-74f7c5143ce9/1dbc84b8-30a1-58d1-a57f-74f7c5143ce9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79959,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_4bc914fcbce612742dc20a00e4954480.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbc84b8-30a1-58d1-a57f-74f7c5143ce9/1dbc84b8-30a1-58d1-a57f-74f7c5143ce9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74322,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_372575d9294c20ec930e042fc859fc10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbc84b8-30a1-58d1-a57f-74f7c5143ce9/1dbc84b8-30a1-58d1-a57f-74f7c5143ce9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84150,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_66573fb077265b478b0a68ed7a1e5dbc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbc84b8-30a1-58d1-a57f-74f7c5143ce9/1dbc84b8-30a1-58d1-a57f-74f7c5143ce9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_7c7359d8c565c6769583ce34eb853aef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbc84b8-30a1-58d1-a57f-74f7c5143ce9/1dbc84b8-30a1-58d1-a57f-74f7c5143ce9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67298,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_45619287a0d94e5dea083f1e1bcc59ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbc84b8-30a1-58d1-a57f-74f7c5143ce9/1dbc84b8-30a1-58d1-a57f-74f7c5143ce9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80210,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_d84094d0b1e43af5ed76c5482f8c5ec1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbc84b8-30a1-58d1-a57f-74f7c5143ce9/1dbc84b8-30a1-58d1-a57f-74f7c5143ce9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65892,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_3aef1e8c286b6fabe559b154203574fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbc84b8-30a1-58d1-a57f-74f7c5143ce9/1dbc84b8-30a1-58d1-a57f-74f7c5143ce9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83051,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_48924bfcc833458b6fdf53a020cd4948.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbc84b8-30a1-58d1-a57f-74f7c5143ce9/1dbc84b8-30a1-58d1-a57f-74f7c5143ce9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75022,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_0ea5352c6c299a31a981fc1fb724a95c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbc84b8-30a1-58d1-a57f-74f7c5143ce9/1dbc84b8-30a1-58d1-a57f-74f7c5143ce9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63163,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/a2/f3a21b06dc648af4c649f5cfd360a224/pa/GD81242_e134b0fddd3b473ec74019250b65994e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 318d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD81242%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [auto1.fr] INFO: Saving data for GD81242: {'created_time': 1774869979.903232, 'last_price_update_time': 1774869979.903242, 'auction_closing_time': 1774969991.0}
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GD81242') HTTP/1.1" 204 0
2026-03-30 11:26:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MC54002> (referer: https://www.auto1.com/v1/car-details-view/MC54002/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0017e49-9ade-501e-bbf9-e99b6212d417 with identifier: MC54002
2026-03-30 11:26:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0017e49-9ade-501e-bbf9-e99b6212d417 with scrape type 1
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0017e49-9ade-501e-bbf9-e99b6212d417
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fce%252F96ce7fdf03876ecd44dee446e9a18d79%252Fpa%252FMC54002_15b9c58c6a0049d92855e8189a685dee.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_15b9c58c6a0049d92855e8189a685dee.jpg already downloaded
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fce%252F96ce7fdf03876ecd44dee446e9a18d79%252Fpa%252FMC54002_157540a77948cab1fad915821c70270b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_157540a77948cab1fad915821c70270b.jpg already downloaded
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fce%252F96ce7fdf03876ecd44dee446e9a18d79%252Fpa%252FMC54002_259ec661ee24807415b7867bb7399986.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_259ec661ee24807415b7867bb7399986.jpg already downloaded
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fce%252F96ce7fdf03876ecd44dee446e9a18d79%252Fpa%252FMC54002_22c95c6795c883908ad33b40292068c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_22c95c6795c883908ad33b40292068c8.jpg already downloaded
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fce%252F96ce7fdf03876ecd44dee446e9a18d79%252Fpa%252FMC54002_debf74859475058713febba7282cf4e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_debf74859475058713febba7282cf4e0.jpg already downloaded
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fce%252F96ce7fdf03876ecd44dee446e9a18d79%252Fpa%252FMC54002_c3cdcac84ffc69fa5cc87f8c0b402874.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_c3cdcac84ffc69fa5cc87f8c0b402874.jpg already downloaded
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fce%252F96ce7fdf03876ecd44dee446e9a18d79%252Fpa%252FMC54002_3e9881f1242f9342127bd19425ec0018.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_3e9881f1242f9342127bd19425ec0018.jpg already downloaded
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fce%252F96ce7fdf03876ecd44dee446e9a18d79%252Fpa%252FMC54002_4d65c6218c00f1d9a1f7551c5712c71a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_4d65c6218c00f1d9a1f7551c5712c71a.jpg already downloaded
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fce%252F96ce7fdf03876ecd44dee446e9a18d79%252Fpa%252FMC54002_f5ad51b555f580c25b7861ba6ff80a9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_f5ad51b555f580c25b7861ba6ff80a9f.jpg already downloaded
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fce%252F96ce7fdf03876ecd44dee446e9a18d79%252Fpa%252FMC54002_e7805428636ca045597bf3872c9a4ecf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_e7805428636ca045597bf3872c9a4ecf.jpg already downloaded
2026-03-30 11:26:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a0017e49-9ade-501e-bbf9-e99b6212d417, identifier: MC54002
2026-03-30 11:26:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a0017e49-9ade-501e-bbf9-e99b6212d417 with identifier: MC54002
2026-03-30 11:26:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a0017e49-9ade-501e-bbf9-e99b6212d417 with identifier: MC54002
2026-03-30 11:26:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a0017e49-9ade-501e-bbf9-e99b6212d417 with identifier: MC54002 to the API
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MC54002>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:56:20Z',
'fuel_type': 'diesel',
'id': 'a0017e49-9ade-501e-bbf9-e99b6212d417',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC54002',
'listing': 'auction',
'location': 'FR, Bourg-en-Bresse',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 145390,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_15b9c58c6a0049d92855e8189a685dee.jpg',
'https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_157540a77948cab1fad915821c70270b.jpg',
'https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_259ec661ee24807415b7867bb7399986.jpg',
'https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_22c95c6795c883908ad33b40292068c8.jpg',
'https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_debf74859475058713febba7282cf4e0.jpg',
'https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_c3cdcac84ffc69fa5cc87f8c0b402874.jpg',
'https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_3e9881f1242f9342127bd19425ec0018.jpg',
'https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_4d65c6218c00f1d9a1f7551c5712c71a.jpg',
'https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_f5ad51b555f580c25b7861ba6ff80a9f.jpg',
'https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_e7805428636ca045597bf3872c9a4ecf.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0017e49-9ade-501e-bbf9-e99b6212d417/a0017e49-9ade-501e-bbf9-e99b6212d417_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94943,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_15b9c58c6a0049d92855e8189a685dee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0017e49-9ade-501e-bbf9-e99b6212d417/a0017e49-9ade-501e-bbf9-e99b6212d417_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_157540a77948cab1fad915821c70270b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0017e49-9ade-501e-bbf9-e99b6212d417/a0017e49-9ade-501e-bbf9-e99b6212d417_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88472,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_259ec661ee24807415b7867bb7399986.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0017e49-9ade-501e-bbf9-e99b6212d417/a0017e49-9ade-501e-bbf9-e99b6212d417_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83250,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_22c95c6795c883908ad33b40292068c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0017e49-9ade-501e-bbf9-e99b6212d417/a0017e49-9ade-501e-bbf9-e99b6212d417_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2772437,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_debf74859475058713febba7282cf4e0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0017e49-9ade-501e-bbf9-e99b6212d417/a0017e49-9ade-501e-bbf9-e99b6212d417_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3361893,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_c3cdcac84ffc69fa5cc87f8c0b402874.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0017e49-9ade-501e-bbf9-e99b6212d417/a0017e49-9ade-501e-bbf9-e99b6212d417_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3018982,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_3e9881f1242f9342127bd19425ec0018.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0017e49-9ade-501e-bbf9-e99b6212d417/a0017e49-9ade-501e-bbf9-e99b6212d417_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3048296,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_4d65c6218c00f1d9a1f7551c5712c71a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0017e49-9ade-501e-bbf9-e99b6212d417/a0017e49-9ade-501e-bbf9-e99b6212d417_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_f5ad51b555f580c25b7861ba6ff80a9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0017e49-9ade-501e-bbf9-e99b6212d417/a0017e49-9ade-501e-bbf9-e99b6212d417_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68531,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/ce/96ce7fdf03876ecd44dee446e9a18d79/pa/MC54002_e7805428636ca045597bf3872c9a4ecf.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-02-01',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
'transmission': 'manual',
'trim': 'Limited FWD',
'year': 2015}
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC54002%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [auto1.fr] INFO: Saving data for MC54002: {'created_time': 1774869980.697742, 'last_price_update_time': 1774869980.697753, 'auction_closing_time': 1774972580.0}
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MC54002') HTTP/1.1" 204 0
2026-03-30 11:26:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MV42781> (referer: https://www.auto1.com/v1/car-details-view/MV42781/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 619e7702-b9ab-5021-8335-410cd56bde12 with identifier: MV42781
2026-03-30 11:26:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 619e7702-b9ab-5021-8335-410cd56bde12 with scrape type 1
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 619e7702-b9ab-5021-8335-410cd56bde12
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcf%252F99cfaea3d0ba231d42246f0e678f4c9b%252Fpa%252FMV42781_4d031edc847009465681396dcaa03734.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_4d031edc847009465681396dcaa03734.jpg not downloaded yet
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcf%252F99cfaea3d0ba231d42246f0e678f4c9b%252Fpa%252FMV42781_0eeb01758f76ec074cce82f9ca268c3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_0eeb01758f76ec074cce82f9ca268c3e.jpg not downloaded yet
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcf%252F99cfaea3d0ba231d42246f0e678f4c9b%252Fpa%252FMV42781_41f0ff4ed76bd6b3a23928fefadc7fae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_41f0ff4ed76bd6b3a23928fefadc7fae.jpg not downloaded yet
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcf%252F99cfaea3d0ba231d42246f0e678f4c9b%252Fpa%252FMV42781_23816c4f0c1eb7ac7bb91588c09971a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_23816c4f0c1eb7ac7bb91588c09971a1.jpg not downloaded yet
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcf%252F99cfaea3d0ba231d42246f0e678f4c9b%252Fpa%252FMV42781_b049576903b3741dd8d47d159846c16b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_b049576903b3741dd8d47d159846c16b.jpg not downloaded yet
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcf%252F99cfaea3d0ba231d42246f0e678f4c9b%252Fpa%252FMV42781_a44ea703655016920716e4b9feca11a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_a44ea703655016920716e4b9feca11a6.jpg not downloaded yet
2026-03-30 11:26:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_0eeb01758f76ec074cce82f9ca268c3e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_4d031edc847009465681396dcaa03734.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_23816c4f0c1eb7ac7bb91588c09971a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_a44ea703655016920716e4b9feca11a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_41f0ff4ed76bd6b3a23928fefadc7fae.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_b049576903b3741dd8d47d159846c16b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383f3f50>
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_619e7702-b9ab-5021-8335-410cd56bde12/619e7702-b9ab-5021-8335-410cd56bde12_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcf%252F99cfaea3d0ba231d42246f0e678f4c9b%252Fpa%252FMV42781_0eeb01758f76ec074cce82f9ca268c3e.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_0eeb01758f76ec074cce82f9ca268c3e.jpg saved to cache
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 619e7702-b9ab-5021-8335-410cd56bde12
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385aabd0>
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_619e7702-b9ab-5021-8335-410cd56bde12/619e7702-b9ab-5021-8335-410cd56bde12_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcf%252F99cfaea3d0ba231d42246f0e678f4c9b%252Fpa%252FMV42781_4d031edc847009465681396dcaa03734.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_4d031edc847009465681396dcaa03734.jpg saved to cache
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 619e7702-b9ab-5021-8335-410cd56bde12
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073859d450>
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_619e7702-b9ab-5021-8335-410cd56bde12/619e7702-b9ab-5021-8335-410cd56bde12_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcf%252F99cfaea3d0ba231d42246f0e678f4c9b%252Fpa%252FMV42781_23816c4f0c1eb7ac7bb91588c09971a1.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_23816c4f0c1eb7ac7bb91588c09971a1.jpg saved to cache
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 619e7702-b9ab-5021-8335-410cd56bde12
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738608e90>
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_619e7702-b9ab-5021-8335-410cd56bde12/619e7702-b9ab-5021-8335-410cd56bde12_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcf%252F99cfaea3d0ba231d42246f0e678f4c9b%252Fpa%252FMV42781_a44ea703655016920716e4b9feca11a6.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_a44ea703655016920716e4b9feca11a6.jpg saved to cache
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 619e7702-b9ab-5021-8335-410cd56bde12
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383e6650>
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_619e7702-b9ab-5021-8335-410cd56bde12/619e7702-b9ab-5021-8335-410cd56bde12_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcf%252F99cfaea3d0ba231d42246f0e678f4c9b%252Fpa%252FMV42781_41f0ff4ed76bd6b3a23928fefadc7fae.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_41f0ff4ed76bd6b3a23928fefadc7fae.jpg saved to cache
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 619e7702-b9ab-5021-8335-410cd56bde12
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383f7310>
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_619e7702-b9ab-5021-8335-410cd56bde12/619e7702-b9ab-5021-8335-410cd56bde12_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcf%252F99cfaea3d0ba231d42246f0e678f4c9b%252Fpa%252FMV42781_b049576903b3741dd8d47d159846c16b.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_b049576903b3741dd8d47d159846c16b.jpg saved to cache
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 619e7702-b9ab-5021-8335-410cd56bde12
2026-03-30 11:26:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 619e7702-b9ab-5021-8335-410cd56bde12, skipping ID generation
2026-03-30 11:26:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 619e7702-b9ab-5021-8335-410cd56bde12 with scrape type 1
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 619e7702-b9ab-5021-8335-410cd56bde12 sending to next pipeline
2026-03-30 11:26:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 619e7702-b9ab-5021-8335-410cd56bde12, identifier: MV42781
2026-03-30 11:26:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 619e7702-b9ab-5021-8335-410cd56bde12 with identifier: MV42781
2026-03-30 11:26:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 619e7702-b9ab-5021-8335-410cd56bde12 with identifier: MV42781
2026-03-30 11:26:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 619e7702-b9ab-5021-8335-410cd56bde12 with identifier: MV42781 to the API
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_b049576903b3741dd8d47d159846c16b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 88,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:39:44Z',
'fuel_type': 'diesel',
'id': '619e7702-b9ab-5021-8335-410cd56bde12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV42781',
'listing': 'auction',
'location': 'FR, Challans',
'make': 'Peugeot',
'model': '308',
'odometer': 293342,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_619e7702-b9ab-5021-8335-410cd56bde12/619e7702-b9ab-5021-8335-410cd56bde12_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_4d031edc847009465681396dcaa03734.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_619e7702-b9ab-5021-8335-410cd56bde12/619e7702-b9ab-5021-8335-410cd56bde12_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_0eeb01758f76ec074cce82f9ca268c3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_619e7702-b9ab-5021-8335-410cd56bde12/619e7702-b9ab-5021-8335-410cd56bde12_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_41f0ff4ed76bd6b3a23928fefadc7fae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_619e7702-b9ab-5021-8335-410cd56bde12/619e7702-b9ab-5021-8335-410cd56bde12_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72249,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_23816c4f0c1eb7ac7bb91588c09971a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_619e7702-b9ab-5021-8335-410cd56bde12/619e7702-b9ab-5021-8335-410cd56bde12_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 133007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_b049576903b3741dd8d47d159846c16b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_619e7702-b9ab-5021-8335-410cd56bde12/619e7702-b9ab-5021-8335-410cd56bde12_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/cf/99cfaea3d0ba231d42246f0e678f4c9b/pa/MV42781_a44ea703655016920716e4b9feca11a6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-11-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2014}
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV42781%27 HTTP/1.1" 200 None
2026-03-30 11:26:21 [auto1.fr] INFO: Saving data for MV42781: {'created_time': 1774869981.889029, 'last_price_update_time': 1774869981.889038, 'auction_closing_time': 1774971584.0}
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MV42781') HTTP/1.1" 204 0
2026-03-30 11:26:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DH43299> (referer: https://www.auto1.com/v1/car-details-view/DH43299/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a88ee5d0-89a0-5bfb-a879-524fdc9fc490 with identifier: DH43299
2026-03-30 11:26:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a88ee5d0-89a0-5bfb-a879-524fdc9fc490 with scrape type 1
2026-03-30 11:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a88ee5d0-89a0-5bfb-a879-524fdc9fc490
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fab%252Fd4aba7e28266e24ea5a976f187123d00%252Fpa%252FDH43299_854bb1ea343c546be25be777476553e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_854bb1ea343c546be25be777476553e8.jpg already downloaded
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fab%252Fd4aba7e28266e24ea5a976f187123d00%252Fpa%252FDH43299_09e08fc0804744f2af5926fcaf458cf8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_09e08fc0804744f2af5926fcaf458cf8.jpg already downloaded
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fab%252Fd4aba7e28266e24ea5a976f187123d00%252Fpa%252FDH43299_20475038e71a94bd603ca311b9a383cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_20475038e71a94bd603ca311b9a383cf.jpg already downloaded
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fab%252Fd4aba7e28266e24ea5a976f187123d00%252Fpa%252FDH43299_1ddeab08af0f1fe338f5ede013bb5ad4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_1ddeab08af0f1fe338f5ede013bb5ad4.jpg already downloaded
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fab%252Fd4aba7e28266e24ea5a976f187123d00%252Fpa%252FDH43299_f36cc078d144843dcb7776dbff688b19.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_f36cc078d144843dcb7776dbff688b19.jpg already downloaded
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fab%252Fd4aba7e28266e24ea5a976f187123d00%252Fpa%252FDH43299_65a1265d121e39733a3808bd1f6d5f5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_65a1265d121e39733a3808bd1f6d5f5f.jpg already downloaded
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fab%252Fd4aba7e28266e24ea5a976f187123d00%252Fpa%252FDH43299_3661371def74045926a6249b590b0962.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_3661371def74045926a6249b590b0962.jpg already downloaded
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fab%252Fd4aba7e28266e24ea5a976f187123d00%252Fpa%252FDH43299_625afbe8a314d7b56b68442ad88fac4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_625afbe8a314d7b56b68442ad88fac4b.jpg already downloaded
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fab%252Fd4aba7e28266e24ea5a976f187123d00%252Fpa%252FDH43299_20f9e9db61f1b2db38e7550bdb36d016.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_20f9e9db61f1b2db38e7550bdb36d016.jpg already downloaded
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fab%252Fd4aba7e28266e24ea5a976f187123d00%252Fpa%252FDH43299_3db2f52f6b0de28b99e0992c6a5bb915.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_3db2f52f6b0de28b99e0992c6a5bb915.jpg already downloaded
2026-03-30 11:26:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a88ee5d0-89a0-5bfb-a879-524fdc9fc490, identifier: DH43299
2026-03-30 11:26:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a88ee5d0-89a0-5bfb-a879-524fdc9fc490 with identifier: DH43299
2026-03-30 11:26:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a88ee5d0-89a0-5bfb-a879-524fdc9fc490 with identifier: DH43299
2026-03-30 11:26:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a88ee5d0-89a0-5bfb-a879-524fdc9fc490 with identifier: DH43299 to the API
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DH43299>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:50:20Z',
'fuel_type': 'diesel',
'id': 'a88ee5d0-89a0-5bfb-a879-524fdc9fc490',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH43299',
'listing': 'auction',
'location': 'FR, Houecourt',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 117984,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_854bb1ea343c546be25be777476553e8.jpg',
'https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_09e08fc0804744f2af5926fcaf458cf8.jpg',
'https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_20475038e71a94bd603ca311b9a383cf.jpg',
'https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_1ddeab08af0f1fe338f5ede013bb5ad4.jpg',
'https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_f36cc078d144843dcb7776dbff688b19.jpg',
'https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_65a1265d121e39733a3808bd1f6d5f5f.jpg',
'https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_3661371def74045926a6249b590b0962.jpg',
'https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_625afbe8a314d7b56b68442ad88fac4b.jpg',
'https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_20f9e9db61f1b2db38e7550bdb36d016.jpg',
'https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_3db2f52f6b0de28b99e0992c6a5bb915.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a88ee5d0-89a0-5bfb-a879-524fdc9fc490/a88ee5d0-89a0-5bfb-a879-524fdc9fc490_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_854bb1ea343c546be25be777476553e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a88ee5d0-89a0-5bfb-a879-524fdc9fc490/a88ee5d0-89a0-5bfb-a879-524fdc9fc490_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61142,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_09e08fc0804744f2af5926fcaf458cf8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a88ee5d0-89a0-5bfb-a879-524fdc9fc490/a88ee5d0-89a0-5bfb-a879-524fdc9fc490_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67242,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_20475038e71a94bd603ca311b9a383cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a88ee5d0-89a0-5bfb-a879-524fdc9fc490/a88ee5d0-89a0-5bfb-a879-524fdc9fc490_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52216,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_1ddeab08af0f1fe338f5ede013bb5ad4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a88ee5d0-89a0-5bfb-a879-524fdc9fc490/a88ee5d0-89a0-5bfb-a879-524fdc9fc490_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_f36cc078d144843dcb7776dbff688b19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a88ee5d0-89a0-5bfb-a879-524fdc9fc490/a88ee5d0-89a0-5bfb-a879-524fdc9fc490_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62892,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_65a1265d121e39733a3808bd1f6d5f5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a88ee5d0-89a0-5bfb-a879-524fdc9fc490/a88ee5d0-89a0-5bfb-a879-524fdc9fc490_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50421,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_3661371def74045926a6249b590b0962.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a88ee5d0-89a0-5bfb-a879-524fdc9fc490/a88ee5d0-89a0-5bfb-a879-524fdc9fc490_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61928,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_625afbe8a314d7b56b68442ad88fac4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a88ee5d0-89a0-5bfb-a879-524fdc9fc490/a88ee5d0-89a0-5bfb-a879-524fdc9fc490_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_20f9e9db61f1b2db38e7550bdb36d016.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a88ee5d0-89a0-5bfb-a879-524fdc9fc490/a88ee5d0-89a0-5bfb-a879-524fdc9fc490_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/ab/d4aba7e28266e24ea5a976f187123d00/pa/DH43299_3db2f52f6b0de28b99e0992c6a5bb915.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-05-31',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Carat Edition BlueMotion',
'transmission': 'manual',
'trim': 'Carat Edition BlueMotion',
'year': 2017}
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH43299%27 HTTP/1.1" 200 None
2026-03-30 11:26:22 [auto1.fr] INFO: Saving data for DH43299: {'created_time': 1774869982.625164, 'last_price_update_time': 1774869982.625173, 'auction_closing_time': 1774972220.0}
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DH43299') HTTP/1.1" 204 0
2026-03-30 11:26:24 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 268.254(s), this was the 2nd time calling it.
2026-03-30 11:26:24 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.334554182472102 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:26:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH76929/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:26:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT37188/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RH39246> (referer: https://www.auto1.com/v1/car-details-view/RH39246/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 044dda5b-016b-5102-98b0-793c551cd6ad with identifier: RH39246
2026-03-30 11:26:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 044dda5b-016b-5102-98b0-793c551cd6ad with scrape type 1
2026-03-30 11:26:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 044dda5b-016b-5102-98b0-793c551cd6ad
2026-03-30 11:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fd4%252Fb2d4684c532e5afc8ab0d181cea0a4ff%252Fpa%252FRH39246_90a13d259ee268af4bb708236ec9bc0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d4684c532e5afc8ab0d181cea0a4ff/pa/RH39246_90a13d259ee268af4bb708236ec9bc0f.jpg already downloaded
2026-03-30 11:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fd4%252Fb2d4684c532e5afc8ab0d181cea0a4ff%252Fpa%252FRH39246_23303d42314ab61d1ed5341c2353a7cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d4684c532e5afc8ab0d181cea0a4ff/pa/RH39246_23303d42314ab61d1ed5341c2353a7cf.jpg already downloaded
2026-03-30 11:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fd4%252Fb2d4684c532e5afc8ab0d181cea0a4ff%252Fpa%252FRH39246_9a49d03802c14dfaeaa87dd2f429207d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d4684c532e5afc8ab0d181cea0a4ff/pa/RH39246_9a49d03802c14dfaeaa87dd2f429207d.jpg already downloaded
2026-03-30 11:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fd4%252Fb2d4684c532e5afc8ab0d181cea0a4ff%252Fpa%252FRH39246_b9e64ebc8c13600152bf6430bf718f4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d4684c532e5afc8ab0d181cea0a4ff/pa/RH39246_b9e64ebc8c13600152bf6430bf718f4c.jpg already downloaded
2026-03-30 11:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fd4%252Fb2d4684c532e5afc8ab0d181cea0a4ff%252Fpa%252FRH39246_6d4531ef4f56ca0485702c35fc3fa4a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d4684c532e5afc8ab0d181cea0a4ff/pa/RH39246_6d4531ef4f56ca0485702c35fc3fa4a1.jpg already downloaded
2026-03-30 11:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fd4%252Fb2d4684c532e5afc8ab0d181cea0a4ff%252Fpa%252FRH39246_293a0980ce8e6e6e0025fce129be4bbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d4/b2d4684c532e5afc8ab0d181cea0a4ff/pa/RH39246_293a0980ce8e6e6e0025fce129be4bbf.jpg already downloaded
2026-03-30 11:26:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 044dda5b-016b-5102-98b0-793c551cd6ad, identifier: RH39246
2026-03-30 11:26:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 044dda5b-016b-5102-98b0-793c551cd6ad with identifier: RH39246
2026-03-30 11:26:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 044dda5b-016b-5102-98b0-793c551cd6ad with identifier: RH39246
2026-03-30 11:26:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 044dda5b-016b-5102-98b0-793c551cd6ad with identifier: RH39246 to the API
2026-03-30 11:26:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RH39246>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:28:00Z',
'fuel_type': 'diesel',
'id': '044dda5b-016b-5102-98b0-793c551cd6ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH39246',
'listing': 'auction',
'location': 'FR, Caluire et Cuire',
'make': 'Lancia',
'model': 'Delta',
'odometer': 188974,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgb2/d4/b2d4684c532e5afc8ab0d181cea0a4ff/pa/RH39246_90a13d259ee268af4bb708236ec9bc0f.jpg',
'https://img-pa.auto1.com/imgb2/d4/b2d4684c532e5afc8ab0d181cea0a4ff/pa/RH39246_23303d42314ab61d1ed5341c2353a7cf.jpg',
'https://img-pa.auto1.com/imgb2/d4/b2d4684c532e5afc8ab0d181cea0a4ff/pa/RH39246_9a49d03802c14dfaeaa87dd2f429207d.jpg',
'https://img-pa.auto1.com/imgb2/d4/b2d4684c532e5afc8ab0d181cea0a4ff/pa/RH39246_b9e64ebc8c13600152bf6430bf718f4c.jpg',
'https://img-pa.auto1.com/imgb2/d4/b2d4684c532e5afc8ab0d181cea0a4ff/pa/RH39246_6d4531ef4f56ca0485702c35fc3fa4a1.jpg',
'https://img-pa.auto1.com/imgb2/d4/b2d4684c532e5afc8ab0d181cea0a4ff/pa/RH39246_293a0980ce8e6e6e0025fce129be4bbf.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044dda5b-016b-5102-98b0-793c551cd6ad/044dda5b-016b-5102-98b0-793c551cd6ad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81324,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/d4/b2d4684c532e5afc8ab0d181cea0a4ff/pa/RH39246_90a13d259ee268af4bb708236ec9bc0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044dda5b-016b-5102-98b0-793c551cd6ad/044dda5b-016b-5102-98b0-793c551cd6ad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85370,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/d4/b2d4684c532e5afc8ab0d181cea0a4ff/pa/RH39246_23303d42314ab61d1ed5341c2353a7cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044dda5b-016b-5102-98b0-793c551cd6ad/044dda5b-016b-5102-98b0-793c551cd6ad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88240,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/d4/b2d4684c532e5afc8ab0d181cea0a4ff/pa/RH39246_9a49d03802c14dfaeaa87dd2f429207d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044dda5b-016b-5102-98b0-793c551cd6ad/044dda5b-016b-5102-98b0-793c551cd6ad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/d4/b2d4684c532e5afc8ab0d181cea0a4ff/pa/RH39246_b9e64ebc8c13600152bf6430bf718f4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044dda5b-016b-5102-98b0-793c551cd6ad/044dda5b-016b-5102-98b0-793c551cd6ad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105690,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/d4/b2d4684c532e5afc8ab0d181cea0a4ff/pa/RH39246_6d4531ef4f56ca0485702c35fc3fa4a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_044dda5b-016b-5102-98b0-793c551cd6ad/044dda5b-016b-5102-98b0-793c551cd6ad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/d4/b2d4684c532e5afc8ab0d181cea0a4ff/pa/RH39246_293a0980ce8e6e6e0025fce129be4bbf.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-02-23',
'seats_number': 5,
'seller_name': None,
'title': 'Lancia Delta 1.6 Diesel Platino',
'transmission': 'automatic',
'trim': 'Platino',
'year': 2011}
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH39246%27 HTTP/1.1" 200 None
2026-03-30 11:26:36 [auto1.fr] INFO: Saving data for RH39246: {'created_time': 1774869996.390673, 'last_price_update_time': 1774869996.390684, 'auction_closing_time': 1774970880.0}
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RH39246') HTTP/1.1" 204 0
2026-03-30 11:26:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UC03940> (referer: https://www.auto1.com/v1/car-details-view/UC03940/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60cfd76a-d8b5-59ec-b1ea-bae64e56027a with identifier: UC03940
2026-03-30 11:26:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60cfd76a-d8b5-59ec-b1ea-bae64e56027a with scrape type 1
2026-03-30 11:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60cfd76a-d8b5-59ec-b1ea-bae64e56027a
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fda%252F3cda31a8a37689b8c9cfd58f159337cf%252Fpa%252FUC03940_fafb6f760767b5f7ef9daa68489ad5cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_fafb6f760767b5f7ef9daa68489ad5cc.jpg already downloaded
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fda%252F3cda31a8a37689b8c9cfd58f159337cf%252Fpa%252FUC03940_0f031d004a09eb535746cfd6dc59690f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_0f031d004a09eb535746cfd6dc59690f.jpg already downloaded
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fda%252F3cda31a8a37689b8c9cfd58f159337cf%252Fpa%252FUC03940_69628d4b24a85dc4fd933d55eae7d8de.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_69628d4b24a85dc4fd933d55eae7d8de.jpg already downloaded
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fda%252F3cda31a8a37689b8c9cfd58f159337cf%252Fpa%252FUC03940_2385e0a73d37601da0939e7c278e3006.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_2385e0a73d37601da0939e7c278e3006.jpg already downloaded
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fda%252F3cda31a8a37689b8c9cfd58f159337cf%252Fpa%252FUC03940_1529492d0eb7e4483b39b6ff11531e8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_1529492d0eb7e4483b39b6ff11531e8a.jpg already downloaded
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fda%252F3cda31a8a37689b8c9cfd58f159337cf%252Fpa%252FUC03940_08b5c572b07499c5db57d87760947515.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_08b5c572b07499c5db57d87760947515.jpg already downloaded
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fda%252F3cda31a8a37689b8c9cfd58f159337cf%252Fpa%252FUC03940_bb8a0f32509a40551aaef65d5bf6c77f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_bb8a0f32509a40551aaef65d5bf6c77f.jpg already downloaded
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fda%252F3cda31a8a37689b8c9cfd58f159337cf%252Fpa%252FUC03940_b55ceebc1833cda4f89c213c1857a750.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_b55ceebc1833cda4f89c213c1857a750.jpg already downloaded
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fda%252F3cda31a8a37689b8c9cfd58f159337cf%252Fpa%252FUC03940_af722a81ac696973ea056a2bcc4bb404.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_af722a81ac696973ea056a2bcc4bb404.jpg already downloaded
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fda%252F3cda31a8a37689b8c9cfd58f159337cf%252Fpa%252FUC03940_c83e0da0f44ca1a932a34a1b26328a9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_c83e0da0f44ca1a932a34a1b26328a9e.jpg already downloaded
2026-03-30 11:26:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 60cfd76a-d8b5-59ec-b1ea-bae64e56027a, identifier: UC03940
2026-03-30 11:26:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 60cfd76a-d8b5-59ec-b1ea-bae64e56027a with identifier: UC03940
2026-03-30 11:26:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 60cfd76a-d8b5-59ec-b1ea-bae64e56027a with identifier: UC03940
2026-03-30 11:26:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 60cfd76a-d8b5-59ec-b1ea-bae64e56027a with identifier: UC03940 to the API
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UC03940>
{'auction_title': '',
'c_o_2_emission_value': 145,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:08:47Z',
'fuel_type': 'petrol',
'id': '60cfd76a-d8b5-59ec-b1ea-bae64e56027a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC03940',
'listing': 'auction',
'location': 'FR, Marly-la-ville',
'make': 'Peugeot',
'model': '207',
'odometer': 137859,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_fafb6f760767b5f7ef9daa68489ad5cc.jpg',
'https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_0f031d004a09eb535746cfd6dc59690f.jpg',
'https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_69628d4b24a85dc4fd933d55eae7d8de.jpg',
'https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_2385e0a73d37601da0939e7c278e3006.jpg',
'https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_1529492d0eb7e4483b39b6ff11531e8a.jpg',
'https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_08b5c572b07499c5db57d87760947515.jpg',
'https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_bb8a0f32509a40551aaef65d5bf6c77f.jpg',
'https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_b55ceebc1833cda4f89c213c1857a750.jpg',
'https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_af722a81ac696973ea056a2bcc4bb404.jpg',
'https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_c83e0da0f44ca1a932a34a1b26328a9e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60cfd76a-d8b5-59ec-b1ea-bae64e56027a/60cfd76a-d8b5-59ec-b1ea-bae64e56027a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2196407,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_fafb6f760767b5f7ef9daa68489ad5cc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60cfd76a-d8b5-59ec-b1ea-bae64e56027a/60cfd76a-d8b5-59ec-b1ea-bae64e56027a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64624,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_0f031d004a09eb535746cfd6dc59690f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60cfd76a-d8b5-59ec-b1ea-bae64e56027a/60cfd76a-d8b5-59ec-b1ea-bae64e56027a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72010,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_69628d4b24a85dc4fd933d55eae7d8de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60cfd76a-d8b5-59ec-b1ea-bae64e56027a/60cfd76a-d8b5-59ec-b1ea-bae64e56027a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60308,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_2385e0a73d37601da0939e7c278e3006.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60cfd76a-d8b5-59ec-b1ea-bae64e56027a/60cfd76a-d8b5-59ec-b1ea-bae64e56027a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60431,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_1529492d0eb7e4483b39b6ff11531e8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60cfd76a-d8b5-59ec-b1ea-bae64e56027a/60cfd76a-d8b5-59ec-b1ea-bae64e56027a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2232994,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_08b5c572b07499c5db57d87760947515.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60cfd76a-d8b5-59ec-b1ea-bae64e56027a/60cfd76a-d8b5-59ec-b1ea-bae64e56027a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59465,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_bb8a0f32509a40551aaef65d5bf6c77f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60cfd76a-d8b5-59ec-b1ea-bae64e56027a/60cfd76a-d8b5-59ec-b1ea-bae64e56027a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67302,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_b55ceebc1833cda4f89c213c1857a750.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60cfd76a-d8b5-59ec-b1ea-bae64e56027a/60cfd76a-d8b5-59ec-b1ea-bae64e56027a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62115,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_af722a81ac696973ea056a2bcc4bb404.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60cfd76a-d8b5-59ec-b1ea-bae64e56027a/60cfd76a-d8b5-59ec-b1ea-bae64e56027a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/da/3cda31a8a37689b8c9cfd58f159337cf/pa/UC03940_c83e0da0f44ca1a932a34a1b26328a9e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-06-08',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 207 1.6 Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2008}
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC03940%27 HTTP/1.1" 200 None
2026-03-30 11:26:38 [auto1.fr] INFO: Saving data for UC03940: {'created_time': 1774869998.458579, 'last_price_update_time': 1774869998.45859, 'auction_closing_time': 1774969727.0}
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UC03940') HTTP/1.1" 204 0
2026-03-30 11:26:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:38 [auto1.fr] INFO: Channel: 24h | Page: 21 | totalHits: 5588 | hits on page: 40
2026-03-30 11:26:38 [auto1.fr] INFO: Found listing with ID: GR61820
2026-03-30 11:26:38 [auto1.fr] INFO: Found listing with ID: RL98096
2026-03-30 11:26:38 [auto1.fr] INFO: Found listing with ID: LN69242
2026-03-30 11:26:38 [auto1.fr] INFO: Found listing with ID: PE74944
2026-03-30 11:26:38 [auto1.fr] INFO: Found listing with ID: AF39730
2026-03-30 11:26:38 [auto1.fr] INFO: Found listing with ID: GV72759
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV72759%27 HTTP/1.1" 200 None
2026-03-30 11:26:38 [auto1.fr] INFO: Scrape type for GV72759: 2
2026-03-30 11:26:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 163e9d49-adf1-51da-ba94-ba54d2a3a09b with identifier: GV72759
2026-03-30 11:26:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 163e9d49-adf1-51da-ba94-ba54d2a3a09b with scrape type 2
2026-03-30 11:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 163e9d49-adf1-51da-ba94-ba54d2a3a09b with scrape type 2
2026-03-30 11:26:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 163e9d49-adf1-51da-ba94-ba54d2a3a09b, identifier: GV72759
2026-03-30 11:26:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 163e9d49-adf1-51da-ba94-ba54d2a3a09b with identifier: GV72759
2026-03-30 11:26:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 163e9d49-adf1-51da-ba94-ba54d2a3a09b with identifier: GV72759
2026-03-30 11:26:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 163e9d49-adf1-51da-ba94-ba54d2a3a09b with identifier: GV72759 to the API
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 141,
'expiration_date': '2026-03-31T15:00:49Z',
'fuel_type': 'hybrid',
'id': '163e9d49-adf1-51da-ba94-ba54d2a3a09b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV72759',
'listing': 'auction',
'make': 'Kia',
'model': 'Niro',
'odometer': 145181,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-18',
'seller_name': None,
'title': 'Kia Niro 1.6 Hybrid Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2017}
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV72759%27 HTTP/1.1" 200 None
2026-03-30 11:26:39 [auto1.fr] INFO: Saving data for GV72759: {'auction_closing_time': 1774969249.0, 'created_time': 1774382777.674131, 'last_price_update_time': 1774869999.141951}
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GV72759') HTTP/1.1" 204 0
2026-03-30 11:26:39 [auto1.fr] INFO: Found listing with ID: NC92603
2026-03-30 11:26:39 [auto1.fr] INFO: Found listing with ID: HM15892
2026-03-30 11:26:39 [auto1.fr] INFO: Found listing with ID: VG13093
2026-03-30 11:26:39 [auto1.fr] INFO: Found listing with ID: DS08548
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS08548%27 HTTP/1.1" 200 None
2026-03-30 11:26:39 [auto1.fr] INFO: Scrape type for DS08548: 1
2026-03-30 11:26:39 [auto1.fr] INFO: Found listing with ID: ZL76511
2026-03-30 11:26:39 [auto1.fr] INFO: Found listing with ID: AY12209
2026-03-30 11:26:39 [auto1.fr] INFO: Found listing with ID: HS41994
2026-03-30 11:26:39 [auto1.fr] INFO: Found listing with ID: JK78743
2026-03-30 11:26:39 [auto1.fr] INFO: Found listing with ID: AB32696
2026-03-30 11:26:39 [auto1.fr] INFO: Found listing with ID: NU28621
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU28621%27 HTTP/1.1" 200 None
2026-03-30 11:26:39 [auto1.fr] INFO: Scrape type for NU28621: 2
2026-03-30 11:26:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84924356-d02e-5bcf-a1a3-390c93dc339e with identifier: NU28621
2026-03-30 11:26:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84924356-d02e-5bcf-a1a3-390c93dc339e with scrape type 2
2026-03-30 11:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84924356-d02e-5bcf-a1a3-390c93dc339e with scrape type 2
2026-03-30 11:26:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 84924356-d02e-5bcf-a1a3-390c93dc339e, identifier: NU28621
2026-03-30 11:26:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 84924356-d02e-5bcf-a1a3-390c93dc339e with identifier: NU28621
2026-03-30 11:26:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 84924356-d02e-5bcf-a1a3-390c93dc339e with identifier: NU28621
2026-03-30 11:26:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 84924356-d02e-5bcf-a1a3-390c93dc339e with identifier: NU28621 to the API
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:06:49Z',
'fuel_type': 'petrol',
'id': '84924356-d02e-5bcf-a1a3-390c93dc339e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU28621',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 156668,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-02-25',
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'automatic',
'trim': '',
'year': 2003}
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU28621%27 HTTP/1.1" 200 None
2026-03-30 11:26:39 [auto1.fr] INFO: Saving data for NU28621: {'auction_closing_time': 1774969609.0, 'created_time': 1773227962.724441, 'last_price_update_time': 1774869999.664568}
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NU28621') HTTP/1.1" 204 0
2026-03-30 11:26:39 [auto1.fr] INFO: Found listing with ID: XB55824
2026-03-30 11:26:39 [auto1.fr] INFO: Found listing with ID: UL28191
2026-03-30 11:26:39 [auto1.fr] INFO: Found listing with ID: VN55404
2026-03-30 11:26:39 [auto1.fr] INFO: Found listing with ID: WS14634
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS14634%27 HTTP/1.1" 200 None
2026-03-30 11:26:39 [auto1.fr] INFO: Scrape type for WS14634: 1
2026-03-30 11:26:39 [auto1.fr] INFO: Found listing with ID: NA77187
2026-03-30 11:26:39 [auto1.fr] INFO: Found listing with ID: JH89520
2026-03-30 11:26:39 [auto1.fr] INFO: Found listing with ID: YS10684
2026-03-30 11:26:39 [auto1.fr] INFO: Found listing with ID: TX45559
2026-03-30 11:26:39 [auto1.fr] INFO: Found listing with ID: RP46008
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP46008%27 HTTP/1.1" 200 None
2026-03-30 11:26:39 [auto1.fr] INFO: Scrape type for RP46008: 2
2026-03-30 11:26:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c2ff0d1-6828-58f6-b29d-1742747cd58b with identifier: RP46008
2026-03-30 11:26:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c2ff0d1-6828-58f6-b29d-1742747cd58b with scrape type 2
2026-03-30 11:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c2ff0d1-6828-58f6-b29d-1742747cd58b with scrape type 2
2026-03-30 11:26:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1c2ff0d1-6828-58f6-b29d-1742747cd58b, identifier: RP46008
2026-03-30 11:26:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1c2ff0d1-6828-58f6-b29d-1742747cd58b with identifier: RP46008
2026-03-30 11:26:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1c2ff0d1-6828-58f6-b29d-1742747cd58b with identifier: RP46008
2026-03-30 11:26:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1c2ff0d1-6828-58f6-b29d-1742747cd58b with identifier: RP46008 to the API
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:48:53Z',
'fuel_type': 'petrol',
'id': '1c2ff0d1-6828-58f6-b29d-1742747cd58b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP46008',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 137268,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-19',
'seller_name': None,
'title': 'Citroen C3 1.2 VTi Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2014}
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP46008%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.fr] INFO: Saving data for RP46008: {'auction_closing_time': 1774972133.0, 'created_time': 1773163042.047457, 'last_price_update_time': 1774870000.225961}
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RP46008') HTTP/1.1" 204 0
2026-03-30 11:26:40 [auto1.fr] INFO: Found listing with ID: RZ94972
2026-03-30 11:26:40 [auto1.fr] INFO: Found listing with ID: DG00282
2026-03-30 11:26:40 [auto1.fr] INFO: Found listing with ID: RG95907
2026-03-30 11:26:40 [auto1.fr] INFO: Found listing with ID: FH61572
2026-03-30 11:26:40 [auto1.fr] INFO: Found listing with ID: ZG40832
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG40832%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.fr] INFO: Scrape type for ZG40832: 2
2026-03-30 11:26:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d13299c1-ba3c-5fba-80d2-66d2090528cd with identifier: ZG40832
2026-03-30 11:26:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d13299c1-ba3c-5fba-80d2-66d2090528cd with scrape type 2
2026-03-30 11:26:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d13299c1-ba3c-5fba-80d2-66d2090528cd with scrape type 2
2026-03-30 11:26:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d13299c1-ba3c-5fba-80d2-66d2090528cd, identifier: ZG40832
2026-03-30 11:26:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d13299c1-ba3c-5fba-80d2-66d2090528cd with identifier: ZG40832
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 11:26:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:26:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d13299c1-ba3c-5fba-80d2-66d2090528cd with identifier: ZG40832
2026-03-30 11:26:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d13299c1-ba3c-5fba-80d2-66d2090528cd with identifier: ZG40832 to the API
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:08:54Z',
'fuel_type': 'petrol',
'id': 'd13299c1-ba3c-5fba-80d2-66d2090528cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG40832',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 30228,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-28',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech GT',
'transmission': 'manual',
'trim': 'GT',
'year': 2021}
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG40832%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.fr] INFO: Saving data for ZG40832: {'auction_closing_time': 1774969734.0, 'created_time': 1774279026.414648, 'last_price_update_time': 1774870000.822347}
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZG40832') HTTP/1.1" 204 0
2026-03-30 11:26:40 [auto1.fr] INFO: Found listing with ID: NL69056
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL69056%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.fr] INFO: Scrape type for NL69056: 1
2026-03-30 11:26:40 [auto1.fr] INFO: Found listing with ID: ET50464
2026-03-30 11:26:40 [auto1.fr] INFO: Found listing with ID: FP01410
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP01410%27 HTTP/1.1" 200 None
2026-03-30 11:26:40 [auto1.fr] INFO: Scrape type for FP01410: 2
2026-03-30 11:26:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26fce022-3de6-534c-8d4c-8ee59bfef853 with identifier: FP01410
2026-03-30 11:26:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26fce022-3de6-534c-8d4c-8ee59bfef853 with scrape type 2
2026-03-30 11:26:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26fce022-3de6-534c-8d4c-8ee59bfef853 with scrape type 2
2026-03-30 11:26:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 26fce022-3de6-534c-8d4c-8ee59bfef853, identifier: FP01410
2026-03-30 11:26:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 26fce022-3de6-534c-8d4c-8ee59bfef853 with identifier: FP01410
2026-03-30 11:26:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 26fce022-3de6-534c-8d4c-8ee59bfef853 with identifier: FP01410
2026-03-30 11:26:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 26fce022-3de6-534c-8d4c-8ee59bfef853 with identifier: FP01410 to the API
2026-03-30 11:26:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:49:38Z',
'fuel_type': 'diesel',
'id': '26fce022-3de6-534c-8d4c-8ee59bfef853',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP01410',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 185916,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-07',
'seller_name': None,
'title': 'Nissan Qashqai 1.6 dCi Connect Edition',
'transmission': 'manual',
'trim': 'Connect Edition',
'year': 2013}
2026-03-30 11:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP01410%27 HTTP/1.1" 200 None
2026-03-30 11:26:41 [auto1.fr] INFO: Saving data for FP01410: {'auction_closing_time': 1774972178.0, 'created_time': 1774364987.118211, 'last_price_update_time': 1774870001.403204}
2026-03-30 11:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FP01410') HTTP/1.1" 204 0
2026-03-30 11:26:41 [auto1.fr] INFO: Found listing with ID: HC90791
2026-03-30 11:26:41 [auto1.fr] INFO: Found listing with ID: TB91463
2026-03-30 11:26:41 [auto1.fr] INFO: Found listing with ID: RX01850
2026-03-30 11:26:41 [auto1.fr] INFO: Found listing with ID: PH66344
2026-03-30 11:26:41 [auto1.fr] INFO: Found listing with ID: RL54968
2026-03-30 11:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL54968%27 HTTP/1.1" 200 None
2026-03-30 11:26:41 [auto1.fr] INFO: Scrape type for RL54968: 1
2026-03-30 11:26:41 [auto1.fr] INFO: Found listing with ID: TD64566
2026-03-30 11:26:41 [auto1.fr] INFO: Found listing with ID: FD94763
2026-03-30 11:26:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH76929> (referer: https://www.auto1.com/v1/car-details-view/KH76929/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d817dc8-b226-5e67-9490-0e9faf32dcd4 with identifier: KH76929
2026-03-30 11:26:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d817dc8-b226-5e67-9490-0e9faf32dcd4 with scrape type 1
2026-03-30 11:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5d817dc8-b226-5e67-9490-0e9faf32dcd4
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F82%252Fdc82a57388b0e10ffbb86223e5f30e6f%252Fpa%252FKH76929_53bac05294476f767c7c03e97e026874.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_53bac05294476f767c7c03e97e026874.jpg not downloaded yet
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F82%252Fdc82a57388b0e10ffbb86223e5f30e6f%252Fpa%252FKH76929_618a6381974bb68876376fc62b96a478.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_618a6381974bb68876376fc62b96a478.jpg not downloaded yet
2026-03-30 11:26:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LJ73279> (referer: https://www.auto1.com/v1/car-details-view/LJ73279/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F82%252Fdc82a57388b0e10ffbb86223e5f30e6f%252Fpa%252FKH76929_fc113ff2df96b208305701796d92c2e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_fc113ff2df96b208305701796d92c2e4.jpg not downloaded yet
2026-03-30 11:26:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F82%252Fdc82a57388b0e10ffbb86223e5f30e6f%252Fpa%252FKH76929_4c8f8618196dd50f1624a088fc02f80c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_4c8f8618196dd50f1624a088fc02f80c.jpg not downloaded yet
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F82%252Fdc82a57388b0e10ffbb86223e5f30e6f%252Fpa%252FKH76929_0be727f661ffa2d7f9821e5099de72bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_0be727f661ffa2d7f9821e5099de72bb.jpg not downloaded yet
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F82%252Fdc82a57388b0e10ffbb86223e5f30e6f%252Fpa%252FKH76929_4c2eb36971750f85cb7e949c851c9325.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_4c2eb36971750f85cb7e949c851c9325.jpg not downloaded yet
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F82%252Fdc82a57388b0e10ffbb86223e5f30e6f%252Fpa%252FKH76929_4a76ce404a86ddc2799261398ae63101.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_4a76ce404a86ddc2799261398ae63101.jpg not downloaded yet
2026-03-30 11:26:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_53bac05294476f767c7c03e97e026874.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F82%252Fdc82a57388b0e10ffbb86223e5f30e6f%252Fpa%252FKH76929_b691c9da52f12609431d82c501ccb821.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_b691c9da52f12609431d82c501ccb821.jpg not downloaded yet
2026-03-30 11:26:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_618a6381974bb68876376fc62b96a478.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F82%252Fdc82a57388b0e10ffbb86223e5f30e6f%252Fpa%252FKH76929_f2b3e8688435fdf342e9c00957b540df.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_f2b3e8688435fdf342e9c00957b540df.jpg not downloaded yet
2026-03-30 11:26:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 980de4fd-d2c3-55c8-a211-3fd38eec81ef with identifier: LJ73279
2026-03-30 11:26:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 980de4fd-d2c3-55c8-a211-3fd38eec81ef with scrape type 1
2026-03-30 11:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 980de4fd-d2c3-55c8-a211-3fd38eec81ef
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fd6%252Fdfd6729199d2e002ebbfeeadb21b16b6%252Fpa%252FLJ73279_7356e474f19c7e0a054ed330ba998b14.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/d6/dfd6729199d2e002ebbfeeadb21b16b6/pa/LJ73279_7356e474f19c7e0a054ed330ba998b14.jpg already downloaded
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fd6%252Fdfd6729199d2e002ebbfeeadb21b16b6%252Fpa%252FLJ73279_4a2dd177405189af1aa05f2f124a5f68.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/d6/dfd6729199d2e002ebbfeeadb21b16b6/pa/LJ73279_4a2dd177405189af1aa05f2f124a5f68.jpg already downloaded
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fd6%252Fdfd6729199d2e002ebbfeeadb21b16b6%252Fpa%252FLJ73279_9d894f97ed2620585513db9d31ea892c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/d6/dfd6729199d2e002ebbfeeadb21b16b6/pa/LJ73279_9d894f97ed2620585513db9d31ea892c.jpg already downloaded
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fd6%252Fdfd6729199d2e002ebbfeeadb21b16b6%252Fpa%252FLJ73279_510a6d1ee175dec56dfc9e3d8a80f57a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/d6/dfd6729199d2e002ebbfeeadb21b16b6/pa/LJ73279_510a6d1ee175dec56dfc9e3d8a80f57a.jpg already downloaded
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fd6%252Fdfd6729199d2e002ebbfeeadb21b16b6%252Fpa%252FLJ73279_0da39f026c5f1030eabf3a733e2d490e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/d6/dfd6729199d2e002ebbfeeadb21b16b6/pa/LJ73279_0da39f026c5f1030eabf3a733e2d490e.jpg already downloaded
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fd6%252Fdfd6729199d2e002ebbfeeadb21b16b6%252Fpa%252FLJ73279_7c04c207e6ada6800d66e11e3f62f876.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/d6/dfd6729199d2e002ebbfeeadb21b16b6/pa/LJ73279_7c04c207e6ada6800d66e11e3f62f876.jpg already downloaded
2026-03-30 11:26:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 980de4fd-d2c3-55c8-a211-3fd38eec81ef, identifier: LJ73279
2026-03-30 11:26:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 980de4fd-d2c3-55c8-a211-3fd38eec81ef with identifier: LJ73279
2026-03-30 11:26:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 980de4fd-d2c3-55c8-a211-3fd38eec81ef with identifier: LJ73279
2026-03-30 11:26:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 980de4fd-d2c3-55c8-a211-3fd38eec81ef with identifier: LJ73279 to the API
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LJ73279>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 65,
'expiration_date': '2026-03-31T15:50:58Z',
'fuel_type': 'petrol',
'id': '980de4fd-d2c3-55c8-a211-3fd38eec81ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ73279',
'listing': 'auction',
'location': 'FR, LA CHAPELLE LONGUEVILLE',
'make': 'Opel',
'model': 'Agila',
'odometer': 126250,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgdf/d6/dfd6729199d2e002ebbfeeadb21b16b6/pa/LJ73279_7356e474f19c7e0a054ed330ba998b14.jpg',
'https://img-pa.auto1.com/imgdf/d6/dfd6729199d2e002ebbfeeadb21b16b6/pa/LJ73279_4a2dd177405189af1aa05f2f124a5f68.jpg',
'https://img-pa.auto1.com/imgdf/d6/dfd6729199d2e002ebbfeeadb21b16b6/pa/LJ73279_9d894f97ed2620585513db9d31ea892c.jpg',
'https://img-pa.auto1.com/imgdf/d6/dfd6729199d2e002ebbfeeadb21b16b6/pa/LJ73279_510a6d1ee175dec56dfc9e3d8a80f57a.jpg',
'https://img-pa.auto1.com/imgdf/d6/dfd6729199d2e002ebbfeeadb21b16b6/pa/LJ73279_0da39f026c5f1030eabf3a733e2d490e.jpg',
'https://img-pa.auto1.com/imgdf/d6/dfd6729199d2e002ebbfeeadb21b16b6/pa/LJ73279_7c04c207e6ada6800d66e11e3f62f876.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_980de4fd-d2c3-55c8-a211-3fd38eec81ef/980de4fd-d2c3-55c8-a211-3fd38eec81ef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/d6/dfd6729199d2e002ebbfeeadb21b16b6/pa/LJ73279_7356e474f19c7e0a054ed330ba998b14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_980de4fd-d2c3-55c8-a211-3fd38eec81ef/980de4fd-d2c3-55c8-a211-3fd38eec81ef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117071,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/d6/dfd6729199d2e002ebbfeeadb21b16b6/pa/LJ73279_4a2dd177405189af1aa05f2f124a5f68.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_980de4fd-d2c3-55c8-a211-3fd38eec81ef/980de4fd-d2c3-55c8-a211-3fd38eec81ef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/d6/dfd6729199d2e002ebbfeeadb21b16b6/pa/LJ73279_9d894f97ed2620585513db9d31ea892c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_980de4fd-d2c3-55c8-a211-3fd38eec81ef/980de4fd-d2c3-55c8-a211-3fd38eec81ef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85127,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/d6/dfd6729199d2e002ebbfeeadb21b16b6/pa/LJ73279_510a6d1ee175dec56dfc9e3d8a80f57a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_980de4fd-d2c3-55c8-a211-3fd38eec81ef/980de4fd-d2c3-55c8-a211-3fd38eec81ef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100546,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/d6/dfd6729199d2e002ebbfeeadb21b16b6/pa/LJ73279_0da39f026c5f1030eabf3a733e2d490e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_980de4fd-d2c3-55c8-a211-3fd38eec81ef/980de4fd-d2c3-55c8-a211-3fd38eec81ef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39368,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/d6/dfd6729199d2e002ebbfeeadb21b16b6/pa/LJ73279_7c04c207e6ada6800d66e11e3f62f876.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-08-08',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Agila 1.0 Enjoy',
'transmission': 'manual',
'trim': 'Enjoy',
'year': 2011}
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ73279%27 HTTP/1.1" 200 None
2026-03-30 11:26:43 [auto1.fr] INFO: Saving data for LJ73279: {'created_time': 1774870003.269836, 'last_price_update_time': 1774870003.269844, 'auction_closing_time': 1774972258.0}
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LJ73279') HTTP/1.1" 204 0
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F82%252Fdc82a57388b0e10ffbb86223e5f30e6f%252Fpa%252FKH76929_65f59463895be97ced2727390f4866c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_65f59463895be97ced2727390f4866c4.jpg not downloaded yet
2026-03-30 11:26:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_fc113ff2df96b208305701796d92c2e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_4a76ce404a86ddc2799261398ae63101.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_4c8f8618196dd50f1624a088fc02f80c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_4c2eb36971750f85cb7e949c851c9325.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383c0bd0>
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d817dc8-b226-5e67-9490-0e9faf32dcd4/5d817dc8-b226-5e67-9490-0e9faf32dcd4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F82%252Fdc82a57388b0e10ffbb86223e5f30e6f%252Fpa%252FKH76929_53bac05294476f767c7c03e97e026874.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_53bac05294476f767c7c03e97e026874.jpg saved to cache
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d817dc8-b226-5e67-9490-0e9faf32dcd4
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a4b3550>
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d817dc8-b226-5e67-9490-0e9faf32dcd4/5d817dc8-b226-5e67-9490-0e9faf32dcd4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F82%252Fdc82a57388b0e10ffbb86223e5f30e6f%252Fpa%252FKH76929_618a6381974bb68876376fc62b96a478.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_618a6381974bb68876376fc62b96a478.jpg saved to cache
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d817dc8-b226-5e67-9490-0e9faf32dcd4
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385440d0>
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d817dc8-b226-5e67-9490-0e9faf32dcd4/5d817dc8-b226-5e67-9490-0e9faf32dcd4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F82%252Fdc82a57388b0e10ffbb86223e5f30e6f%252Fpa%252FKH76929_fc113ff2df96b208305701796d92c2e4.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_fc113ff2df96b208305701796d92c2e4.jpg saved to cache
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d817dc8-b226-5e67-9490-0e9faf32dcd4
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073868cb50>
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d817dc8-b226-5e67-9490-0e9faf32dcd4/5d817dc8-b226-5e67-9490-0e9faf32dcd4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F82%252Fdc82a57388b0e10ffbb86223e5f30e6f%252Fpa%252FKH76929_4a76ce404a86ddc2799261398ae63101.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_4a76ce404a86ddc2799261398ae63101.jpg saved to cache
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5d817dc8-b226-5e67-9490-0e9faf32dcd4
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383beed0>
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d817dc8-b226-5e67-9490-0e9faf32dcd4/5d817dc8-b226-5e67-9490-0e9faf32dcd4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F82%252Fdc82a57388b0e10ffbb86223e5f30e6f%252Fpa%252FKH76929_4c8f8618196dd50f1624a088fc02f80c.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_4c8f8618196dd50f1624a088fc02f80c.jpg saved to cache
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d817dc8-b226-5e67-9490-0e9faf32dcd4
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073ad0c910>
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d817dc8-b226-5e67-9490-0e9faf32dcd4/5d817dc8-b226-5e67-9490-0e9faf32dcd4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F82%252Fdc82a57388b0e10ffbb86223e5f30e6f%252Fpa%252FKH76929_4c2eb36971750f85cb7e949c851c9325.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_4c2eb36971750f85cb7e949c851c9325.jpg saved to cache
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5d817dc8-b226-5e67-9490-0e9faf32dcd4
2026-03-30 11:26:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_65f59463895be97ced2727390f4866c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_b691c9da52f12609431d82c501ccb821.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_f2b3e8688435fdf342e9c00957b540df.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_0be727f661ffa2d7f9821e5099de72bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073860ab90>
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d817dc8-b226-5e67-9490-0e9faf32dcd4/5d817dc8-b226-5e67-9490-0e9faf32dcd4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F82%252Fdc82a57388b0e10ffbb86223e5f30e6f%252Fpa%252FKH76929_65f59463895be97ced2727390f4866c4.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_65f59463895be97ced2727390f4866c4.jpg saved to cache
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5d817dc8-b226-5e67-9490-0e9faf32dcd4
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738427790>
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d817dc8-b226-5e67-9490-0e9faf32dcd4/5d817dc8-b226-5e67-9490-0e9faf32dcd4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F82%252Fdc82a57388b0e10ffbb86223e5f30e6f%252Fpa%252FKH76929_b691c9da52f12609431d82c501ccb821.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_b691c9da52f12609431d82c501ccb821.jpg saved to cache
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5d817dc8-b226-5e67-9490-0e9faf32dcd4
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385a90d0>
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d817dc8-b226-5e67-9490-0e9faf32dcd4/5d817dc8-b226-5e67-9490-0e9faf32dcd4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F82%252Fdc82a57388b0e10ffbb86223e5f30e6f%252Fpa%252FKH76929_f2b3e8688435fdf342e9c00957b540df.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_f2b3e8688435fdf342e9c00957b540df.jpg saved to cache
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5d817dc8-b226-5e67-9490-0e9faf32dcd4
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383e7990>
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d817dc8-b226-5e67-9490-0e9faf32dcd4/5d817dc8-b226-5e67-9490-0e9faf32dcd4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F82%252Fdc82a57388b0e10ffbb86223e5f30e6f%252Fpa%252FKH76929_0be727f661ffa2d7f9821e5099de72bb.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_0be727f661ffa2d7f9821e5099de72bb.jpg saved to cache
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5d817dc8-b226-5e67-9490-0e9faf32dcd4
2026-03-30 11:26:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d817dc8-b226-5e67-9490-0e9faf32dcd4, skipping ID generation
2026-03-30 11:26:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d817dc8-b226-5e67-9490-0e9faf32dcd4 with scrape type 1
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d817dc8-b226-5e67-9490-0e9faf32dcd4 sending to next pipeline
2026-03-30 11:26:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5d817dc8-b226-5e67-9490-0e9faf32dcd4, identifier: KH76929
2026-03-30 11:26:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5d817dc8-b226-5e67-9490-0e9faf32dcd4 with identifier: KH76929
2026-03-30 11:26:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5d817dc8-b226-5e67-9490-0e9faf32dcd4 with identifier: KH76929
2026-03-30 11:26:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5d817dc8-b226-5e67-9490-0e9faf32dcd4 with identifier: KH76929 to the API
2026-03-30 11:26:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_0be727f661ffa2d7f9821e5099de72bb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 34,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 224,
'expiration_date': '2026-03-31T15:49:43Z',
'fuel_type': 'hybrid',
'id': '5d817dc8-b226-5e67-9490-0e9faf32dcd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH76929',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Peugeot',
'model': '508',
'odometer': 146432,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d817dc8-b226-5e67-9490-0e9faf32dcd4/5d817dc8-b226-5e67-9490-0e9faf32dcd4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87437,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_53bac05294476f767c7c03e97e026874.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d817dc8-b226-5e67-9490-0e9faf32dcd4/5d817dc8-b226-5e67-9490-0e9faf32dcd4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78974,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_618a6381974bb68876376fc62b96a478.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d817dc8-b226-5e67-9490-0e9faf32dcd4/5d817dc8-b226-5e67-9490-0e9faf32dcd4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_fc113ff2df96b208305701796d92c2e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d817dc8-b226-5e67-9490-0e9faf32dcd4/5d817dc8-b226-5e67-9490-0e9faf32dcd4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_4c8f8618196dd50f1624a088fc02f80c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d817dc8-b226-5e67-9490-0e9faf32dcd4/5d817dc8-b226-5e67-9490-0e9faf32dcd4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92639,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_0be727f661ffa2d7f9821e5099de72bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d817dc8-b226-5e67-9490-0e9faf32dcd4/5d817dc8-b226-5e67-9490-0e9faf32dcd4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75760,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_4c2eb36971750f85cb7e949c851c9325.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d817dc8-b226-5e67-9490-0e9faf32dcd4/5d817dc8-b226-5e67-9490-0e9faf32dcd4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88411,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_4a76ce404a86ddc2799261398ae63101.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d817dc8-b226-5e67-9490-0e9faf32dcd4/5d817dc8-b226-5e67-9490-0e9faf32dcd4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117864,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_b691c9da52f12609431d82c501ccb821.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d817dc8-b226-5e67-9490-0e9faf32dcd4/5d817dc8-b226-5e67-9490-0e9faf32dcd4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84231,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_f2b3e8688435fdf342e9c00957b540df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d817dc8-b226-5e67-9490-0e9faf32dcd4/5d817dc8-b226-5e67-9490-0e9faf32dcd4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/82/dc82a57388b0e10ffbb86223e5f30e6f/pa/KH76929_65f59463895be97ced2727390f4866c4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-16',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 508 1.6 Hybrid 225 GT',
'transmission': 'automatic',
'trim': '225 GT',
'year': 2021}
2026-03-30 11:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH76929%27 HTTP/1.1" 200 None
2026-03-30 11:26:44 [auto1.fr] INFO: Saving data for KH76929: {'created_time': 1774870004.391107, 'last_price_update_time': 1774870004.391117, 'auction_closing_time': 1774972183.0}
2026-03-30 11:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KH76929') HTTP/1.1" 204 0
2026-03-30 11:26:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:46 [auto1.fr] INFO: Channel: 24h | Page: 22 | totalHits: 5588 | hits on page: 40
2026-03-30 11:26:46 [auto1.fr] INFO: Found listing with ID: AC36773
2026-03-30 11:26:46 [auto1.fr] INFO: Found listing with ID: JX07863
2026-03-30 11:26:46 [auto1.fr] INFO: Found listing with ID: PW59367
2026-03-30 11:26:46 [auto1.fr] INFO: Found listing with ID: LJ10054
2026-03-30 11:26:46 [auto1.fr] INFO: Found listing with ID: HT05552
2026-03-30 11:26:46 [auto1.fr] INFO: Found listing with ID: NC58814
2026-03-30 11:26:46 [auto1.fr] INFO: Found listing with ID: RH41219
2026-03-30 11:26:46 [auto1.fr] INFO: Found listing with ID: AC90567
2026-03-30 11:26:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC90567%27 HTTP/1.1" 200 None
2026-03-30 11:26:46 [auto1.fr] INFO: Scrape type for AC90567: 2
2026-03-30 11:26:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb0eeef1-88d4-5e65-9667-10b7501fe5b6 with identifier: AC90567
2026-03-30 11:26:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb0eeef1-88d4-5e65-9667-10b7501fe5b6 with scrape type 2
2026-03-30 11:26:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb0eeef1-88d4-5e65-9667-10b7501fe5b6 with scrape type 2
2026-03-30 11:26:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bb0eeef1-88d4-5e65-9667-10b7501fe5b6, identifier: AC90567
2026-03-30 11:26:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bb0eeef1-88d4-5e65-9667-10b7501fe5b6 with identifier: AC90567
2026-03-30 11:26:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bb0eeef1-88d4-5e65-9667-10b7501fe5b6 with identifier: AC90567
2026-03-30 11:26:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bb0eeef1-88d4-5e65-9667-10b7501fe5b6 with identifier: AC90567 to the API
2026-03-30 11:26:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 65,
'expiration_date': '2026-03-31T15:00:16Z',
'fuel_type': 'diesel',
'id': 'bb0eeef1-88d4-5e65-9667-10b7501fe5b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC90567',
'listing': 'auction',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 178960,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-12-14',
'seller_name': None,
'title': 'Renault Kangoo 1.5 dCi Express Grand Confort',
'transmission': 'manual',
'trim': 'Express Grand Confort',
'year': 2006}
2026-03-30 11:26:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC90567%27 HTTP/1.1" 200 None
2026-03-30 11:26:47 [auto1.fr] INFO: Saving data for AC90567: {'auction_closing_time': 1774969216.0, 'created_time': 1774382770.884191, 'last_price_update_time': 1774870007.206141}
2026-03-30 11:26:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AC90567') HTTP/1.1" 204 0
2026-03-30 11:26:47 [auto1.fr] INFO: Found listing with ID: VE45996
2026-03-30 11:26:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE45996%27 HTTP/1.1" 200 None
2026-03-30 11:26:47 [auto1.fr] INFO: Scrape type for VE45996: 2
2026-03-30 11:26:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d6aa349-6a4c-5c00-8770-056f635eb89f with identifier: VE45996
2026-03-30 11:26:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d6aa349-6a4c-5c00-8770-056f635eb89f with scrape type 2
2026-03-30 11:26:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d6aa349-6a4c-5c00-8770-056f635eb89f with scrape type 2
2026-03-30 11:26:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6d6aa349-6a4c-5c00-8770-056f635eb89f, identifier: VE45996
2026-03-30 11:26:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6d6aa349-6a4c-5c00-8770-056f635eb89f with identifier: VE45996
2026-03-30 11:26:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6d6aa349-6a4c-5c00-8770-056f635eb89f with identifier: VE45996
2026-03-30 11:26:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6d6aa349-6a4c-5c00-8770-056f635eb89f with identifier: VE45996 to the API
2026-03-30 11:26:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:30:52Z',
'fuel_type': 'petrol',
'id': '6d6aa349-6a4c-5c00-8770-056f635eb89f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE45996',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 192820,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-30',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2013}
2026-03-30 11:26:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE45996%27 HTTP/1.1" 200 None
2026-03-30 11:26:47 [auto1.fr] INFO: Saving data for VE45996: {'auction_closing_time': 1774971052.0, 'created_time': 1774538202.558975, 'last_price_update_time': 1774870007.771395}
2026-03-30 11:26:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VE45996') HTTP/1.1" 204 0
2026-03-30 11:26:47 [auto1.fr] INFO: Found listing with ID: NU50982
2026-03-30 11:26:47 [auto1.fr] INFO: Found listing with ID: JX21918
2026-03-30 11:26:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX21918%27 HTTP/1.1" 200 None
2026-03-30 11:26:47 [auto1.fr] INFO: Scrape type for JX21918: 2
2026-03-30 11:26:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dce644e1-5460-5b43-959f-52476a1750ac with identifier: JX21918
2026-03-30 11:26:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dce644e1-5460-5b43-959f-52476a1750ac with scrape type 2
2026-03-30 11:26:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dce644e1-5460-5b43-959f-52476a1750ac with scrape type 2
2026-03-30 11:26:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dce644e1-5460-5b43-959f-52476a1750ac, identifier: JX21918
2026-03-30 11:26:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dce644e1-5460-5b43-959f-52476a1750ac with identifier: JX21918
2026-03-30 11:26:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dce644e1-5460-5b43-959f-52476a1750ac with identifier: JX21918
2026-03-30 11:26:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dce644e1-5460-5b43-959f-52476a1750ac with identifier: JX21918 to the API
2026-03-30 11:26:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-31T15:22:47Z',
'fuel_type': 'hybrid',
'id': 'dce644e1-5460-5b43-959f-52476a1750ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX21918',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 147925,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-28',
'seller_name': None,
'title': 'Toyota RAV 4 2.5 Hybrid 4x2 Black Edition',
'transmission': 'automatic',
'trim': '4x2 Black Edition',
'year': 2022}
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX21918%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Saving data for JX21918: {'auction_closing_time': 1774970567.0, 'created_time': 1774297206.912827, 'last_price_update_time': 1774870008.217914}
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JX21918') HTTP/1.1" 204 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: EN97801
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: DB80908
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB80908%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for DB80908: 1
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: JJ59660
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: CD08371
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD08371%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for CD08371: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: CR45449
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR45449%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for CR45449: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: VR63320
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: HJ75341
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HJ75341%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for HJ75341: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: AJ10016
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: WC83197
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC83197%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for WC83197: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: MZ88305
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ88305%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for MZ88305: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: VX56195
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: BH01130
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: YF10781
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF10781%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for YF10781: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: ZW91296
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW91296%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for ZW91296: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: MG28923
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG28923%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for MG28923: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: RC91479
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: HM40518
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HM40518%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for HM40518: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: WA87686
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: HR90410
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: BP76976
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP76976%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for BP76976: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: MS47798
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS47798%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for MS47798: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: DC79217
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: NA00973
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: JN64906
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: DB80378
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: SM15350
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM15350%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for SM15350: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: TX11821
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: PV35629
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: XP85932
2026-03-30 11:26:51 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.745(s), this was the 1st time calling it.
2026-03-30 11:26:51 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.772841729468771 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:26:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KB70829> (referer: https://www.auto1.com/v1/car-details-view/KB70829/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 299ac634-d0a0-5739-b41d-089a5d348098 with identifier: KB70829
2026-03-30 11:26:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 299ac634-d0a0-5739-b41d-089a5d348098 with scrape type 1
2026-03-30 11:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 299ac634-d0a0-5739-b41d-089a5d348098
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F82%252Fc5821fbbe5a3a295cf9d9f0c4a29c5c1%252Fpa%252FKB70829_5c4a3e54a76be9bd5d1cf35ccbf67e27.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_5c4a3e54a76be9bd5d1cf35ccbf67e27.jpg not downloaded yet
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F82%252Fc5821fbbe5a3a295cf9d9f0c4a29c5c1%252Fpa%252FKB70829_0e6821f2d38e0bbba842920a92be8f47.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_0e6821f2d38e0bbba842920a92be8f47.jpg not downloaded yet
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F82%252Fc5821fbbe5a3a295cf9d9f0c4a29c5c1%252Fpa%252FKB70829_1014c03d2aefa235519e7cfff31ae194.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_1014c03d2aefa235519e7cfff31ae194.jpg not downloaded yet
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F82%252Fc5821fbbe5a3a295cf9d9f0c4a29c5c1%252Fpa%252FKB70829_341cbdfd74b7433414a9d4b797ea7bc6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_341cbdfd74b7433414a9d4b797ea7bc6.jpg not downloaded yet
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F82%252Fc5821fbbe5a3a295cf9d9f0c4a29c5c1%252Fpa%252FKB70829_a1897dca85ab0425d53ee2f519fa87f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_a1897dca85ab0425d53ee2f519fa87f2.jpg not downloaded yet
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F82%252Fc5821fbbe5a3a295cf9d9f0c4a29c5c1%252Fpa%252FKB70829_0bd96b77df2d9138a6f58a54b0982a19.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_0bd96b77df2d9138a6f58a54b0982a19.jpg not downloaded yet
2026-03-30 11:26:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_5c4a3e54a76be9bd5d1cf35ccbf67e27.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_0e6821f2d38e0bbba842920a92be8f47.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_1014c03d2aefa235519e7cfff31ae194.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_a1897dca85ab0425d53ee2f519fa87f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073845f110>
2026-03-30 11:26:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299ac634-d0a0-5739-b41d-089a5d348098/299ac634-d0a0-5739-b41d-089a5d348098_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F82%252Fc5821fbbe5a3a295cf9d9f0c4a29c5c1%252Fpa%252FKB70829_5c4a3e54a76be9bd5d1cf35ccbf67e27.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_5c4a3e54a76be9bd5d1cf35ccbf67e27.jpg saved to cache
2026-03-30 11:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 299ac634-d0a0-5739-b41d-089a5d348098
2026-03-30 11:26:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383f3a10>
2026-03-30 11:26:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299ac634-d0a0-5739-b41d-089a5d348098/299ac634-d0a0-5739-b41d-089a5d348098_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F82%252Fc5821fbbe5a3a295cf9d9f0c4a29c5c1%252Fpa%252FKB70829_0e6821f2d38e0bbba842920a92be8f47.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_0e6821f2d38e0bbba842920a92be8f47.jpg saved to cache
2026-03-30 11:26:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 299ac634-d0a0-5739-b41d-089a5d348098
2026-03-30 11:26:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_341cbdfd74b7433414a9d4b797ea7bc6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_0bd96b77df2d9138a6f58a54b0982a19.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383e7210>
2026-03-30 11:26:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299ac634-d0a0-5739-b41d-089a5d348098/299ac634-d0a0-5739-b41d-089a5d348098_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F82%252Fc5821fbbe5a3a295cf9d9f0c4a29c5c1%252Fpa%252FKB70829_1014c03d2aefa235519e7cfff31ae194.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_1014c03d2aefa235519e7cfff31ae194.jpg saved to cache
2026-03-30 11:26:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 299ac634-d0a0-5739-b41d-089a5d348098
2026-03-30 11:26:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384290d0>
2026-03-30 11:26:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299ac634-d0a0-5739-b41d-089a5d348098/299ac634-d0a0-5739-b41d-089a5d348098_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F82%252Fc5821fbbe5a3a295cf9d9f0c4a29c5c1%252Fpa%252FKB70829_a1897dca85ab0425d53ee2f519fa87f2.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_a1897dca85ab0425d53ee2f519fa87f2.jpg saved to cache
2026-03-30 11:26:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 299ac634-d0a0-5739-b41d-089a5d348098
2026-03-30 11:26:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738688850>
2026-03-30 11:26:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299ac634-d0a0-5739-b41d-089a5d348098/299ac634-d0a0-5739-b41d-089a5d348098_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F82%252Fc5821fbbe5a3a295cf9d9f0c4a29c5c1%252Fpa%252FKB70829_341cbdfd74b7433414a9d4b797ea7bc6.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_341cbdfd74b7433414a9d4b797ea7bc6.jpg saved to cache
2026-03-30 11:26:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 299ac634-d0a0-5739-b41d-089a5d348098
2026-03-30 11:26:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07384da010>
2026-03-30 11:26:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_299ac634-d0a0-5739-b41d-089a5d348098/299ac634-d0a0-5739-b41d-089a5d348098_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F82%252Fc5821fbbe5a3a295cf9d9f0c4a29c5c1%252Fpa%252FKB70829_0bd96b77df2d9138a6f58a54b0982a19.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_0bd96b77df2d9138a6f58a54b0982a19.jpg saved to cache
2026-03-30 11:26:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 299ac634-d0a0-5739-b41d-089a5d348098
2026-03-30 11:26:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 299ac634-d0a0-5739-b41d-089a5d348098, skipping ID generation
2026-03-30 11:26:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 299ac634-d0a0-5739-b41d-089a5d348098 with scrape type 1
2026-03-30 11:26:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 299ac634-d0a0-5739-b41d-089a5d348098 sending to next pipeline
2026-03-30 11:26:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 299ac634-d0a0-5739-b41d-089a5d348098, identifier: KB70829
2026-03-30 11:26:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 299ac634-d0a0-5739-b41d-089a5d348098 with identifier: KB70829
2026-03-30 11:26:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 299ac634-d0a0-5739-b41d-089a5d348098 with identifier: KB70829
2026-03-30 11:26:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 299ac634-d0a0-5739-b41d-089a5d348098 with identifier: KB70829 to the API
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_0bd96b77df2d9138a6f58a54b0982a19.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:46:27Z',
'fuel_type': 'petrol',
'id': '299ac634-d0a0-5739-b41d-089a5d348098',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB70829',
'listing': 'auction',
'location': 'FR, Limoges',
'make': 'Peugeot',
'model': '208',
'odometer': 144358,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299ac634-d0a0-5739-b41d-089a5d348098/299ac634-d0a0-5739-b41d-089a5d348098_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76805,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_5c4a3e54a76be9bd5d1cf35ccbf67e27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299ac634-d0a0-5739-b41d-089a5d348098/299ac634-d0a0-5739-b41d-089a5d348098_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78815,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_0e6821f2d38e0bbba842920a92be8f47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299ac634-d0a0-5739-b41d-089a5d348098/299ac634-d0a0-5739-b41d-089a5d348098_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68631,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_1014c03d2aefa235519e7cfff31ae194.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299ac634-d0a0-5739-b41d-089a5d348098/299ac634-d0a0-5739-b41d-089a5d348098_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_341cbdfd74b7433414a9d4b797ea7bc6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299ac634-d0a0-5739-b41d-089a5d348098/299ac634-d0a0-5739-b41d-089a5d348098_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86412,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_a1897dca85ab0425d53ee2f519fa87f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_299ac634-d0a0-5739-b41d-089a5d348098/299ac634-d0a0-5739-b41d-089a5d348098_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/82/c5821fbbe5a3a295cf9d9f0c4a29c5c1/pa/KB70829_0bd96b77df2d9138a6f58a54b0982a19.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.6 Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2013}
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB70829%27 HTTP/1.1" 200 None
2026-03-30 11:26:54 [auto1.fr] INFO: Saving data for KB70829: {'created_time': 1774870014.727413, 'last_price_update_time': 1774870014.727424, 'auction_closing_time': 1774971987.0}
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KB70829') HTTP/1.1" 204 0
2026-03-30 11:26:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL69056/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT37188> (referer: https://www.auto1.com/v1/car-details-view/UT37188/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77cbd143-ead7-54db-8f09-723767921244 with identifier: UT37188
2026-03-30 11:26:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77cbd143-ead7-54db-8f09-723767921244 with scrape type 1
2026-03-30 11:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 77cbd143-ead7-54db-8f09-723767921244
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fd5%252F85d5f165325056d26668356999311268%252Fpa%252FUT37188_6283322fb905ac0cf111912f057aee91.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_6283322fb905ac0cf111912f057aee91.jpg already downloaded
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fd5%252F85d5f165325056d26668356999311268%252Fpa%252FUT37188_211c5d7af0292381c83cd18e5803c788.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_211c5d7af0292381c83cd18e5803c788.jpg already downloaded
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fd5%252F85d5f165325056d26668356999311268%252Fpa%252FUT37188_2884bad8d550908f10eeeb9309a4110b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_2884bad8d550908f10eeeb9309a4110b.jpg already downloaded
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fd5%252F85d5f165325056d26668356999311268%252Fpa%252FUT37188_f61b74f605560b500ff23b0f8ec1a169.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_f61b74f605560b500ff23b0f8ec1a169.jpg already downloaded
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fd5%252F85d5f165325056d26668356999311268%252Fpa%252FUT37188_e3507e73994d50036b20ec7ea558bc10.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_e3507e73994d50036b20ec7ea558bc10.jpg already downloaded
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fd5%252F85d5f165325056d26668356999311268%252Fpa%252FUT37188_62319b7627443d189d30339c40848ac6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_62319b7627443d189d30339c40848ac6.jpg already downloaded
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fd5%252F85d5f165325056d26668356999311268%252Fpa%252FUT37188_57e9f7cd217d59b0d01d91490e0287c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_57e9f7cd217d59b0d01d91490e0287c7.jpg already downloaded
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fd5%252F85d5f165325056d26668356999311268%252Fpa%252FUT37188_0cf973aa68a1eb4118740e6e410e6da0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_0cf973aa68a1eb4118740e6e410e6da0.jpg already downloaded
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fd5%252F85d5f165325056d26668356999311268%252Fpa%252FUT37188_f9d14f2be0dc64449b3ab7ed300a8824.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_f9d14f2be0dc64449b3ab7ed300a8824.jpg already downloaded
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fd5%252F85d5f165325056d26668356999311268%252Fpa%252FUT37188_c8143741080a2045efb4e8981ecd86fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_c8143741080a2045efb4e8981ecd86fa.jpg already downloaded
2026-03-30 11:26:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 77cbd143-ead7-54db-8f09-723767921244, identifier: UT37188
2026-03-30 11:26:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 77cbd143-ead7-54db-8f09-723767921244 with identifier: UT37188
2026-03-30 11:26:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 77cbd143-ead7-54db-8f09-723767921244 with identifier: UT37188
2026-03-30 11:26:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 77cbd143-ead7-54db-8f09-723767921244 with identifier: UT37188 to the API
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UT37188>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:37:42Z',
'fuel_type': 'diesel',
'id': '77cbd143-ead7-54db-8f09-723767921244',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT37188',
'listing': 'auction',
'location': 'FR, Boé',
'make': 'Peugeot',
'model': '3008',
'odometer': 105833,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_6283322fb905ac0cf111912f057aee91.jpg',
'https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_211c5d7af0292381c83cd18e5803c788.jpg',
'https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_2884bad8d550908f10eeeb9309a4110b.jpg',
'https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_f61b74f605560b500ff23b0f8ec1a169.jpg',
'https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_e3507e73994d50036b20ec7ea558bc10.jpg',
'https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_62319b7627443d189d30339c40848ac6.jpg',
'https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_57e9f7cd217d59b0d01d91490e0287c7.jpg',
'https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_0cf973aa68a1eb4118740e6e410e6da0.jpg',
'https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_f9d14f2be0dc64449b3ab7ed300a8824.jpg',
'https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_c8143741080a2045efb4e8981ecd86fa.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cbd143-ead7-54db-8f09-723767921244/77cbd143-ead7-54db-8f09-723767921244_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79835,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_6283322fb905ac0cf111912f057aee91.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cbd143-ead7-54db-8f09-723767921244/77cbd143-ead7-54db-8f09-723767921244_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68974,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_211c5d7af0292381c83cd18e5803c788.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cbd143-ead7-54db-8f09-723767921244/77cbd143-ead7-54db-8f09-723767921244_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62322,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_2884bad8d550908f10eeeb9309a4110b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cbd143-ead7-54db-8f09-723767921244/77cbd143-ead7-54db-8f09-723767921244_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55265,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_f61b74f605560b500ff23b0f8ec1a169.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cbd143-ead7-54db-8f09-723767921244/77cbd143-ead7-54db-8f09-723767921244_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61597,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_e3507e73994d50036b20ec7ea558bc10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cbd143-ead7-54db-8f09-723767921244/77cbd143-ead7-54db-8f09-723767921244_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65210,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_62319b7627443d189d30339c40848ac6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cbd143-ead7-54db-8f09-723767921244/77cbd143-ead7-54db-8f09-723767921244_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55150,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_57e9f7cd217d59b0d01d91490e0287c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cbd143-ead7-54db-8f09-723767921244/77cbd143-ead7-54db-8f09-723767921244_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67364,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_0cf973aa68a1eb4118740e6e410e6da0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cbd143-ead7-54db-8f09-723767921244/77cbd143-ead7-54db-8f09-723767921244_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66259,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_f9d14f2be0dc64449b3ab7ed300a8824.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cbd143-ead7-54db-8f09-723767921244/77cbd143-ead7-54db-8f09-723767921244_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78413,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/d5/85d5f165325056d26668356999311268/pa/UT37188_c8143741080a2045efb4e8981ecd86fa.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-10-08',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 Blue-HDi Active Business',
'transmission': 'manual',
'trim': 'Active Business',
'year': 2015}
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT37188%27 HTTP/1.1" 200 None
2026-03-30 11:26:56 [auto1.fr] INFO: Saving data for UT37188: {'created_time': 1774870016.504731, 'last_price_update_time': 1774870016.504741, 'auction_closing_time': 1774971462.0}
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UT37188') HTTP/1.1" 204 0
2026-03-30 11:26:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:26:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL54968/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WS14634/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CG67141/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY69551> (referer: https://www.auto1.com/v1/car-details-view/CY69551/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7814e877-c2e1-5a26-8c1a-c32129dbc14a with identifier: CY69551
2026-03-30 11:27:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7814e877-c2e1-5a26-8c1a-c32129dbc14a with scrape type 1
2026-03-30 11:27:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7814e877-c2e1-5a26-8c1a-c32129dbc14a
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F23%252F9f23a48175eaf3dc908e67b89b46f5b7%252Fpa%252FCY69551_2ded5ed1e043b49ffec03eaf81b2dc6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_2ded5ed1e043b49ffec03eaf81b2dc6a.jpg already downloaded
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F23%252F9f23a48175eaf3dc908e67b89b46f5b7%252Fpa%252FCY69551_cad62995783aab0a92ba12e6f8244d67.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_cad62995783aab0a92ba12e6f8244d67.jpg already downloaded
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F23%252F9f23a48175eaf3dc908e67b89b46f5b7%252Fpa%252FCY69551_da7e3c537c20dc5fa67c3e294a5a6790.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_da7e3c537c20dc5fa67c3e294a5a6790.jpg already downloaded
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F23%252F9f23a48175eaf3dc908e67b89b46f5b7%252Fpa%252FCY69551_6e45c1aea065d568b5903ce5fa8a0ff3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_6e45c1aea065d568b5903ce5fa8a0ff3.jpg already downloaded
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F23%252F9f23a48175eaf3dc908e67b89b46f5b7%252Fpa%252FCY69551_2f8c0938882491b8caf6c767be522b2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_2f8c0938882491b8caf6c767be522b2e.jpg already downloaded
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F23%252F9f23a48175eaf3dc908e67b89b46f5b7%252Fpa%252FCY69551_87d3f6c62ed8283833f745c70e26c229.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_87d3f6c62ed8283833f745c70e26c229.jpg already downloaded
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F23%252F9f23a48175eaf3dc908e67b89b46f5b7%252Fpa%252FCY69551_fa89a4a800083351e6199fbdd112a448.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_fa89a4a800083351e6199fbdd112a448.jpg already downloaded
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F23%252F9f23a48175eaf3dc908e67b89b46f5b7%252Fpa%252FCY69551_4050f328fc93663142e025a2c8688c02.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_4050f328fc93663142e025a2c8688c02.jpg already downloaded
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F23%252F9f23a48175eaf3dc908e67b89b46f5b7%252Fpa%252FCY69551_230bff2fae86498ab9b5956f5c7540dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_230bff2fae86498ab9b5956f5c7540dc.jpg already downloaded
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F23%252F9f23a48175eaf3dc908e67b89b46f5b7%252Fpa%252FCY69551_ff70d796de7e8dffa691190b038f3a46.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_ff70d796de7e8dffa691190b038f3a46.jpg already downloaded
2026-03-30 11:27:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7814e877-c2e1-5a26-8c1a-c32129dbc14a, identifier: CY69551
2026-03-30 11:27:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7814e877-c2e1-5a26-8c1a-c32129dbc14a with identifier: CY69551
2026-03-30 11:27:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7814e877-c2e1-5a26-8c1a-c32129dbc14a with identifier: CY69551
2026-03-30 11:27:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7814e877-c2e1-5a26-8c1a-c32129dbc14a with identifier: CY69551 to the API
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CY69551>
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:05:42Z',
'fuel_type': 'diesel',
'id': '7814e877-c2e1-5a26-8c1a-c32129dbc14a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY69551',
'listing': 'auction',
'location': 'FR, Boé',
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 186020,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_2ded5ed1e043b49ffec03eaf81b2dc6a.jpg',
'https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_cad62995783aab0a92ba12e6f8244d67.jpg',
'https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_da7e3c537c20dc5fa67c3e294a5a6790.jpg',
'https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_6e45c1aea065d568b5903ce5fa8a0ff3.jpg',
'https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_2f8c0938882491b8caf6c767be522b2e.jpg',
'https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_87d3f6c62ed8283833f745c70e26c229.jpg',
'https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_fa89a4a800083351e6199fbdd112a448.jpg',
'https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_4050f328fc93663142e025a2c8688c02.jpg',
'https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_230bff2fae86498ab9b5956f5c7540dc.jpg',
'https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_ff70d796de7e8dffa691190b038f3a46.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7814e877-c2e1-5a26-8c1a-c32129dbc14a/7814e877-c2e1-5a26-8c1a-c32129dbc14a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84643,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_2ded5ed1e043b49ffec03eaf81b2dc6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7814e877-c2e1-5a26-8c1a-c32129dbc14a/7814e877-c2e1-5a26-8c1a-c32129dbc14a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_cad62995783aab0a92ba12e6f8244d67.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7814e877-c2e1-5a26-8c1a-c32129dbc14a/7814e877-c2e1-5a26-8c1a-c32129dbc14a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75261,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_da7e3c537c20dc5fa67c3e294a5a6790.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7814e877-c2e1-5a26-8c1a-c32129dbc14a/7814e877-c2e1-5a26-8c1a-c32129dbc14a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52280,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_6e45c1aea065d568b5903ce5fa8a0ff3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7814e877-c2e1-5a26-8c1a-c32129dbc14a/7814e877-c2e1-5a26-8c1a-c32129dbc14a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71892,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_2f8c0938882491b8caf6c767be522b2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7814e877-c2e1-5a26-8c1a-c32129dbc14a/7814e877-c2e1-5a26-8c1a-c32129dbc14a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_87d3f6c62ed8283833f745c70e26c229.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7814e877-c2e1-5a26-8c1a-c32129dbc14a/7814e877-c2e1-5a26-8c1a-c32129dbc14a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54767,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_fa89a4a800083351e6199fbdd112a448.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7814e877-c2e1-5a26-8c1a-c32129dbc14a/7814e877-c2e1-5a26-8c1a-c32129dbc14a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89610,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_4050f328fc93663142e025a2c8688c02.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7814e877-c2e1-5a26-8c1a-c32129dbc14a/7814e877-c2e1-5a26-8c1a-c32129dbc14a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91171,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_230bff2fae86498ab9b5956f5c7540dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7814e877-c2e1-5a26-8c1a-c32129dbc14a/7814e877-c2e1-5a26-8c1a-c32129dbc14a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/23/9f23a48175eaf3dc908e67b89b46f5b7/pa/CY69551_ff70d796de7e8dffa691190b038f3a46.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-23',
'seats_number': 9,
'seller_name': None,
'title': 'Citroen Jumpy 1.5 Blue-HDi Comfort M',
'transmission': 'manual',
'trim': 'Comfort M',
'year': 2019}
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY69551%27 HTTP/1.1" 200 None
2026-03-30 11:27:04 [auto1.fr] INFO: Saving data for CY69551: {'created_time': 1774870024.573494, 'last_price_update_time': 1774870024.573504, 'auction_closing_time': 1774969542.0}
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CY69551') HTTP/1.1" 204 0
2026-03-30 11:27:05 [scrapy.extensions.logstats] INFO: Crawled 258 pages (at 31 pages/min), scraped 203 items (at 23 items/min)
2026-03-30 11:27:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:27:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WS14634> (referer: https://www.auto1.com/v1/car-details-view/WS14634/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a0ca930-af65-513f-9cca-5d1b1cb5a744 with identifier: WS14634
2026-03-30 11:27:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a0ca930-af65-513f-9cca-5d1b1cb5a744 with scrape type 1
2026-03-30 11:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a0ca930-af65-513f-9cca-5d1b1cb5a744
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Ff4%252Fe6f46d8aece14e5e68ef2b705bc30dbf%252Fpa%252FWS14634_9ba2ba62b75bf27e406532a50f357bb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_9ba2ba62b75bf27e406532a50f357bb2.jpg already downloaded
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Ff4%252Fe6f46d8aece14e5e68ef2b705bc30dbf%252Fpa%252FWS14634_e1a3f8ca44872c176c44803c5a84d5c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_e1a3f8ca44872c176c44803c5a84d5c2.jpg already downloaded
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Ff4%252Fe6f46d8aece14e5e68ef2b705bc30dbf%252Fpa%252FWS14634_7a97120d9ab9196e1c73fb5887cd86eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_7a97120d9ab9196e1c73fb5887cd86eb.jpg already downloaded
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Ff4%252Fe6f46d8aece14e5e68ef2b705bc30dbf%252Fpa%252FWS14634_f9fb02979bcb5b53cdd079bd64529c94.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_f9fb02979bcb5b53cdd079bd64529c94.jpg already downloaded
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Ff4%252Fe6f46d8aece14e5e68ef2b705bc30dbf%252Fpa%252FWS14634_f5a5cd9026fb77735d7fdf0585ad3b76.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_f5a5cd9026fb77735d7fdf0585ad3b76.jpg already downloaded
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Ff4%252Fe6f46d8aece14e5e68ef2b705bc30dbf%252Fpa%252FWS14634_acc7442e58a43c0831be523028c1229c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_acc7442e58a43c0831be523028c1229c.jpg already downloaded
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Ff4%252Fe6f46d8aece14e5e68ef2b705bc30dbf%252Fpa%252FWS14634_a7d001c73f06083e0e1b89c859b40053.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_a7d001c73f06083e0e1b89c859b40053.jpg already downloaded
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Ff4%252Fe6f46d8aece14e5e68ef2b705bc30dbf%252Fpa%252FWS14634_de16aa083028a87489fbc7b605d3650a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_de16aa083028a87489fbc7b605d3650a.jpg already downloaded
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Ff4%252Fe6f46d8aece14e5e68ef2b705bc30dbf%252Fpa%252FWS14634_971c7c2a575705b04169d414267788be.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_971c7c2a575705b04169d414267788be.jpg already downloaded
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Ff4%252Fe6f46d8aece14e5e68ef2b705bc30dbf%252Fpa%252FWS14634_4d7a01e5bf53c30d2c583aba28173a72.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_4d7a01e5bf53c30d2c583aba28173a72.jpg already downloaded
2026-03-30 11:27:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9a0ca930-af65-513f-9cca-5d1b1cb5a744, identifier: WS14634
2026-03-30 11:27:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9a0ca930-af65-513f-9cca-5d1b1cb5a744 with identifier: WS14634
2026-03-30 11:27:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9a0ca930-af65-513f-9cca-5d1b1cb5a744 with identifier: WS14634
2026-03-30 11:27:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9a0ca930-af65-513f-9cca-5d1b1cb5a744 with identifier: WS14634 to the API
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WS14634>
{'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:14:28Z',
'fuel_type': 'diesel',
'id': '9a0ca930-af65-513f-9cca-5d1b1cb5a744',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS14634',
'listing': 'auction',
'location': 'FR, Houecourt',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 135851,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_9ba2ba62b75bf27e406532a50f357bb2.jpg',
'https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_e1a3f8ca44872c176c44803c5a84d5c2.jpg',
'https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_7a97120d9ab9196e1c73fb5887cd86eb.jpg',
'https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_f9fb02979bcb5b53cdd079bd64529c94.jpg',
'https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_f5a5cd9026fb77735d7fdf0585ad3b76.jpg',
'https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_acc7442e58a43c0831be523028c1229c.jpg',
'https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_a7d001c73f06083e0e1b89c859b40053.jpg',
'https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_de16aa083028a87489fbc7b605d3650a.jpg',
'https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_971c7c2a575705b04169d414267788be.jpg',
'https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_4d7a01e5bf53c30d2c583aba28173a72.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0ca930-af65-513f-9cca-5d1b1cb5a744/9a0ca930-af65-513f-9cca-5d1b1cb5a744_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2754668,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_9ba2ba62b75bf27e406532a50f357bb2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0ca930-af65-513f-9cca-5d1b1cb5a744/9a0ca930-af65-513f-9cca-5d1b1cb5a744_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2639809,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_e1a3f8ca44872c176c44803c5a84d5c2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0ca930-af65-513f-9cca-5d1b1cb5a744/9a0ca930-af65-513f-9cca-5d1b1cb5a744_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2663984,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_7a97120d9ab9196e1c73fb5887cd86eb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0ca930-af65-513f-9cca-5d1b1cb5a744/9a0ca930-af65-513f-9cca-5d1b1cb5a744_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2325041,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_f9fb02979bcb5b53cdd079bd64529c94.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0ca930-af65-513f-9cca-5d1b1cb5a744/9a0ca930-af65-513f-9cca-5d1b1cb5a744_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2569512,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_f5a5cd9026fb77735d7fdf0585ad3b76.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0ca930-af65-513f-9cca-5d1b1cb5a744/9a0ca930-af65-513f-9cca-5d1b1cb5a744_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2549302,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_acc7442e58a43c0831be523028c1229c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0ca930-af65-513f-9cca-5d1b1cb5a744/9a0ca930-af65-513f-9cca-5d1b1cb5a744_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2370025,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_a7d001c73f06083e0e1b89c859b40053.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0ca930-af65-513f-9cca-5d1b1cb5a744/9a0ca930-af65-513f-9cca-5d1b1cb5a744_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2665753,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_de16aa083028a87489fbc7b605d3650a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0ca930-af65-513f-9cca-5d1b1cb5a744/9a0ca930-af65-513f-9cca-5d1b1cb5a744_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2815588,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_971c7c2a575705b04169d414267788be.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0ca930-af65-513f-9cca-5d1b1cb5a744/9a0ca930-af65-513f-9cca-5d1b1cb5a744_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2542578,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge6/f4/e6f46d8aece14e5e68ef2b705bc30dbf/pa/WS14634_4d7a01e5bf53c30d2c583aba28173a72.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-05-01',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 CDI AMG Sport',
'transmission': 'automatic',
'trim': 'AMG Sport',
'year': 2016}
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS14634%27 HTTP/1.1" 200 None
2026-03-30 11:27:06 [auto1.fr] INFO: Saving data for WS14634: {'created_time': 1774870026.403267, 'last_price_update_time': 1774870026.403277, 'auction_closing_time': 1774970068.0}
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WS14634') HTTP/1.1" 204 0
2026-03-30 11:27:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL54968> (referer: https://www.auto1.com/v1/car-details-view/RL54968/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2f6bb26-1343-5c4c-9576-105660f19c2f with identifier: RL54968
2026-03-30 11:27:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2f6bb26-1343-5c4c-9576-105660f19c2f with scrape type 1
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f2f6bb26-1343-5c4c-9576-105660f19c2f
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff0707fa25fa1619a1050ce45ececf9%252Fpa%252FRL54968_38035f6cc09a5b6bb4835129ea34eeab.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_38035f6cc09a5b6bb4835129ea34eeab.jpg already downloaded
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff0707fa25fa1619a1050ce45ececf9%252Fpa%252FRL54968_d227e877640d7ad848f876e2edc7493e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_d227e877640d7ad848f876e2edc7493e.jpg already downloaded
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff0707fa25fa1619a1050ce45ececf9%252Fpa%252FRL54968_eaf2de517976fa290a12a2ad0e9779be.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_eaf2de517976fa290a12a2ad0e9779be.jpg already downloaded
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff0707fa25fa1619a1050ce45ececf9%252Fpa%252FRL54968_ed359e73834c57ac11f8312d368ad2a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_ed359e73834c57ac11f8312d368ad2a6.jpg already downloaded
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff0707fa25fa1619a1050ce45ececf9%252Fpa%252FRL54968_1107743d0e21c348c57860cb93b9aaa2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_1107743d0e21c348c57860cb93b9aaa2.jpg already downloaded
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff0707fa25fa1619a1050ce45ececf9%252Fpa%252FRL54968_db162ad21e85fa3828a2e000cc890993.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_db162ad21e85fa3828a2e000cc890993.jpg already downloaded
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff0707fa25fa1619a1050ce45ececf9%252Fpa%252FRL54968_6b37f54eb206a0993dd5eb2a7c2d6928.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_6b37f54eb206a0993dd5eb2a7c2d6928.jpg already downloaded
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff0707fa25fa1619a1050ce45ececf9%252Fpa%252FRL54968_c7cc0deaff5e7941c34d35164dfc79cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_c7cc0deaff5e7941c34d35164dfc79cf.jpg already downloaded
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff0707fa25fa1619a1050ce45ececf9%252Fpa%252FRL54968_46a339f0c9bcbf0df03b14dc9f291f98.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_46a339f0c9bcbf0df03b14dc9f291f98.jpg already downloaded
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff0707fa25fa1619a1050ce45ececf9%252Fpa%252FRL54968_996f0297e35208ed389630423887bd1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_996f0297e35208ed389630423887bd1f.jpg already downloaded
2026-03-30 11:27:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f2f6bb26-1343-5c4c-9576-105660f19c2f, identifier: RL54968
2026-03-30 11:27:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f2f6bb26-1343-5c4c-9576-105660f19c2f with identifier: RL54968
2026-03-30 11:27:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f2f6bb26-1343-5c4c-9576-105660f19c2f with identifier: RL54968
2026-03-30 11:27:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f2f6bb26-1343-5c4c-9576-105660f19c2f with identifier: RL54968 to the API
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RL54968>
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:15:55Z',
'fuel_type': 'petrol',
'id': 'f2f6bb26-1343-5c4c-9576-105660f19c2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL54968',
'listing': 'auction',
'location': 'FR, Marly-la-ville',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 73800,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_38035f6cc09a5b6bb4835129ea34eeab.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_d227e877640d7ad848f876e2edc7493e.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_eaf2de517976fa290a12a2ad0e9779be.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_ed359e73834c57ac11f8312d368ad2a6.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_1107743d0e21c348c57860cb93b9aaa2.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_db162ad21e85fa3828a2e000cc890993.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_6b37f54eb206a0993dd5eb2a7c2d6928.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_c7cc0deaff5e7941c34d35164dfc79cf.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_46a339f0c9bcbf0df03b14dc9f291f98.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_996f0297e35208ed389630423887bd1f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2f6bb26-1343-5c4c-9576-105660f19c2f/f2f6bb26-1343-5c4c-9576-105660f19c2f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122184,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_38035f6cc09a5b6bb4835129ea34eeab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2f6bb26-1343-5c4c-9576-105660f19c2f/f2f6bb26-1343-5c4c-9576-105660f19c2f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3038327,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_d227e877640d7ad848f876e2edc7493e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2f6bb26-1343-5c4c-9576-105660f19c2f/f2f6bb26-1343-5c4c-9576-105660f19c2f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_eaf2de517976fa290a12a2ad0e9779be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2f6bb26-1343-5c4c-9576-105660f19c2f/f2f6bb26-1343-5c4c-9576-105660f19c2f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_ed359e73834c57ac11f8312d368ad2a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2f6bb26-1343-5c4c-9576-105660f19c2f/f2f6bb26-1343-5c4c-9576-105660f19c2f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97491,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_1107743d0e21c348c57860cb93b9aaa2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2f6bb26-1343-5c4c-9576-105660f19c2f/f2f6bb26-1343-5c4c-9576-105660f19c2f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3082033,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_db162ad21e85fa3828a2e000cc890993.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2f6bb26-1343-5c4c-9576-105660f19c2f/f2f6bb26-1343-5c4c-9576-105660f19c2f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2640096,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_6b37f54eb206a0993dd5eb2a7c2d6928.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2f6bb26-1343-5c4c-9576-105660f19c2f/f2f6bb26-1343-5c4c-9576-105660f19c2f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107254,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_c7cc0deaff5e7941c34d35164dfc79cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2f6bb26-1343-5c4c-9576-105660f19c2f/f2f6bb26-1343-5c4c-9576-105660f19c2f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115924,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_46a339f0c9bcbf0df03b14dc9f291f98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2f6bb26-1343-5c4c-9576-105660f19c2f/f2f6bb26-1343-5c4c-9576-105660f19c2f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67246,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff0707fa25fa1619a1050ce45ececf9/pa/RL54968_996f0297e35208ed389630423887bd1f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-23',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 1.5 TSI ACT Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2020}
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL54968%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [auto1.fr] INFO: Saving data for RL54968: {'created_time': 1774870027.570654, 'last_price_update_time': 1774870027.570666, 'auction_closing_time': 1774970155.0}
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RL54968') HTTP/1.1" 204 0
2026-03-30 11:27:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CG67141> (referer: https://www.auto1.com/v1/car-details-view/CG67141/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95c56f38-ae57-5d1e-b781-84e6e3a7eb5a with identifier: CG67141
2026-03-30 11:27:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95c56f38-ae57-5d1e-b781-84e6e3a7eb5a with scrape type 1
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95c56f38-ae57-5d1e-b781-84e6e3a7eb5a
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F9d%252F8a9d5d7a169eb141a96561fed0c88322%252Fpa%252FCG67141_960ad0e40331af58fa40541e5ecf553b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_960ad0e40331af58fa40541e5ecf553b.jpg already downloaded
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F9d%252F8a9d5d7a169eb141a96561fed0c88322%252Fpa%252FCG67141_6e5ded6e014412c61b00c5d7b006c1d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_6e5ded6e014412c61b00c5d7b006c1d5.jpg already downloaded
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F9d%252F8a9d5d7a169eb141a96561fed0c88322%252Fpa%252FCG67141_ee2d0025b0ef65ac5f4deec0c5e7ae17.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_ee2d0025b0ef65ac5f4deec0c5e7ae17.jpg already downloaded
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F9d%252F8a9d5d7a169eb141a96561fed0c88322%252Fpa%252FCG67141_bb95e0e045b99bce3ac4693c6e313fdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_bb95e0e045b99bce3ac4693c6e313fdf.jpg already downloaded
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F9d%252F8a9d5d7a169eb141a96561fed0c88322%252Fpa%252FCG67141_0683be4cc44e3cc9230e761e12c07adf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_0683be4cc44e3cc9230e761e12c07adf.jpg already downloaded
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F9d%252F8a9d5d7a169eb141a96561fed0c88322%252Fpa%252FCG67141_1b7aa4eed1cfa9307ee7a4b7bf6f444b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_1b7aa4eed1cfa9307ee7a4b7bf6f444b.jpg already downloaded
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F9d%252F8a9d5d7a169eb141a96561fed0c88322%252Fpa%252FCG67141_07c98ab1ab757283d82991c8381f0943.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_07c98ab1ab757283d82991c8381f0943.jpg already downloaded
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F9d%252F8a9d5d7a169eb141a96561fed0c88322%252Fpa%252FCG67141_37d62d4f2b1600457bb9e9f0d633ad1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_37d62d4f2b1600457bb9e9f0d633ad1d.jpg already downloaded
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F9d%252F8a9d5d7a169eb141a96561fed0c88322%252Fpa%252FCG67141_a7896704dbebceb38caf7ed7e4294849.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_a7896704dbebceb38caf7ed7e4294849.jpg already downloaded
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F9d%252F8a9d5d7a169eb141a96561fed0c88322%252Fpa%252FCG67141_a6a8c21a15af91149ac8cfaff8b77ff3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_a6a8c21a15af91149ac8cfaff8b77ff3.jpg already downloaded
2026-03-30 11:27:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 95c56f38-ae57-5d1e-b781-84e6e3a7eb5a, identifier: CG67141
2026-03-30 11:27:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 95c56f38-ae57-5d1e-b781-84e6e3a7eb5a with identifier: CG67141
2026-03-30 11:27:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 95c56f38-ae57-5d1e-b781-84e6e3a7eb5a with identifier: CG67141
2026-03-30 11:27:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 95c56f38-ae57-5d1e-b781-84e6e3a7eb5a with identifier: CG67141 to the API
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CG67141>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:11:07Z',
'fuel_type': 'diesel',
'id': '95c56f38-ae57-5d1e-b781-84e6e3a7eb5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG67141',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Audi',
'model': 'Q2',
'odometer': 180107,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_960ad0e40331af58fa40541e5ecf553b.jpg',
'https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_6e5ded6e014412c61b00c5d7b006c1d5.jpg',
'https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_ee2d0025b0ef65ac5f4deec0c5e7ae17.jpg',
'https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_bb95e0e045b99bce3ac4693c6e313fdf.jpg',
'https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_0683be4cc44e3cc9230e761e12c07adf.jpg',
'https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_1b7aa4eed1cfa9307ee7a4b7bf6f444b.jpg',
'https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_07c98ab1ab757283d82991c8381f0943.jpg',
'https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_37d62d4f2b1600457bb9e9f0d633ad1d.jpg',
'https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_a7896704dbebceb38caf7ed7e4294849.jpg',
'https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_a6a8c21a15af91149ac8cfaff8b77ff3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c56f38-ae57-5d1e-b781-84e6e3a7eb5a/95c56f38-ae57-5d1e-b781-84e6e3a7eb5a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 366178,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_960ad0e40331af58fa40541e5ecf553b.jpg',
'Width': 1200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c56f38-ae57-5d1e-b781-84e6e3a7eb5a/95c56f38-ae57-5d1e-b781-84e6e3a7eb5a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343146,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_6e5ded6e014412c61b00c5d7b006c1d5.jpg',
'Width': 1200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c56f38-ae57-5d1e-b781-84e6e3a7eb5a/95c56f38-ae57-5d1e-b781-84e6e3a7eb5a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349480,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_ee2d0025b0ef65ac5f4deec0c5e7ae17.jpg',
'Width': 1200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c56f38-ae57-5d1e-b781-84e6e3a7eb5a/95c56f38-ae57-5d1e-b781-84e6e3a7eb5a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348238,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_bb95e0e045b99bce3ac4693c6e313fdf.jpg',
'Width': 1200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c56f38-ae57-5d1e-b781-84e6e3a7eb5a/95c56f38-ae57-5d1e-b781-84e6e3a7eb5a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66516,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_0683be4cc44e3cc9230e761e12c07adf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c56f38-ae57-5d1e-b781-84e6e3a7eb5a/95c56f38-ae57-5d1e-b781-84e6e3a7eb5a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_1b7aa4eed1cfa9307ee7a4b7bf6f444b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c56f38-ae57-5d1e-b781-84e6e3a7eb5a/95c56f38-ae57-5d1e-b781-84e6e3a7eb5a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47336,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_07c98ab1ab757283d82991c8381f0943.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c56f38-ae57-5d1e-b781-84e6e3a7eb5a/95c56f38-ae57-5d1e-b781-84e6e3a7eb5a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61160,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_37d62d4f2b1600457bb9e9f0d633ad1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c56f38-ae57-5d1e-b781-84e6e3a7eb5a/95c56f38-ae57-5d1e-b781-84e6e3a7eb5a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355763,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_a7896704dbebceb38caf7ed7e4294849.jpg',
'Width': 1200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c56f38-ae57-5d1e-b781-84e6e3a7eb5a/95c56f38-ae57-5d1e-b781-84e6e3a7eb5a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341000,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/img8a/9d/8a9d5d7a169eb141a96561fed0c88322/pa/CG67141_a6a8c21a15af91149ac8cfaff8b77ff3.jpg',
'Width': 1200}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-07',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q2 35 TDI quattro sport',
'transmission': 'automatic',
'trim': 'quattro sport',
'year': 2017}
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG67141%27 HTTP/1.1" 200 None
2026-03-30 11:27:08 [auto1.fr] INFO: Saving data for CG67141: {'created_time': 1774870028.405738, 'last_price_update_time': 1774870028.405751, 'auction_closing_time': 1774969867.0}
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CG67141') HTTP/1.1" 204 0
2026-03-30 11:27:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DB80908/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL69056> (referer: https://www.auto1.com/v1/car-details-view/NL69056/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92 with identifier: NL69056
2026-03-30 11:27:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92 with scrape type 1
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fd4%252F16d454457928a0591dd0fc4b9b37536a%252Fpa%252FNL69056_baccbbf297bbef6def3f03445996be32.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_baccbbf297bbef6def3f03445996be32.jpg already downloaded
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fd4%252F16d454457928a0591dd0fc4b9b37536a%252Fpa%252FNL69056_32747226284c2663549b9b369d730e51.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_32747226284c2663549b9b369d730e51.jpg already downloaded
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fd4%252F16d454457928a0591dd0fc4b9b37536a%252Fpa%252FNL69056_9b0c5ed929b5811451179985643356d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_9b0c5ed929b5811451179985643356d4.jpg already downloaded
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fd4%252F16d454457928a0591dd0fc4b9b37536a%252Fpa%252FNL69056_d5e67a6425885dedee10f842932779ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_d5e67a6425885dedee10f842932779ea.jpg already downloaded
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fd4%252F16d454457928a0591dd0fc4b9b37536a%252Fpa%252FNL69056_377d19c717d62f93c8fa4f339b17fd00.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_377d19c717d62f93c8fa4f339b17fd00.jpg already downloaded
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fd4%252F16d454457928a0591dd0fc4b9b37536a%252Fpa%252FNL69056_8b27a252833780159c7ad792a161cdaa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_8b27a252833780159c7ad792a161cdaa.jpg already downloaded
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fd4%252F16d454457928a0591dd0fc4b9b37536a%252Fpa%252FNL69056_f660b1b27b4cd555fc6361038b122ca4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_f660b1b27b4cd555fc6361038b122ca4.jpg already downloaded
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fd4%252F16d454457928a0591dd0fc4b9b37536a%252Fpa%252FNL69056_10c9ea63468f79accb6b2f35c1e711e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_10c9ea63468f79accb6b2f35c1e711e5.jpg already downloaded
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fd4%252F16d454457928a0591dd0fc4b9b37536a%252Fpa%252FNL69056_9dbb77b48c376ea088c86313c2dd5dba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_9dbb77b48c376ea088c86313c2dd5dba.jpg already downloaded
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fd4%252F16d454457928a0591dd0fc4b9b37536a%252Fpa%252FNL69056_078009d47f81f721bf4e72b47396f636.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_078009d47f81f721bf4e72b47396f636.jpg already downloaded
2026-03-30 11:27:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92, identifier: NL69056
2026-03-30 11:27:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92 with identifier: NL69056
2026-03-30 11:27:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92 with identifier: NL69056
2026-03-30 11:27:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92 with identifier: NL69056 to the API
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NL69056>
{'auction_title': '',
'c_o_2_emission_value': 90,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '0.9L',
'engine_horse_power': 85,
'expiration_date': '2026-03-31T15:14:47Z',
'fuel_type': 'petrol',
'id': '8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL69056',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Fiat',
'model': '500C',
'odometer': 122723,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_baccbbf297bbef6def3f03445996be32.jpg',
'https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_32747226284c2663549b9b369d730e51.jpg',
'https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_9b0c5ed929b5811451179985643356d4.jpg',
'https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_d5e67a6425885dedee10f842932779ea.jpg',
'https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_377d19c717d62f93c8fa4f339b17fd00.jpg',
'https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_8b27a252833780159c7ad792a161cdaa.jpg',
'https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_f660b1b27b4cd555fc6361038b122ca4.jpg',
'https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_10c9ea63468f79accb6b2f35c1e711e5.jpg',
'https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_9dbb77b48c376ea088c86313c2dd5dba.jpg',
'https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_078009d47f81f721bf4e72b47396f636.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92/8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2445752,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_baccbbf297bbef6def3f03445996be32.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92/8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79618,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_32747226284c2663549b9b369d730e51.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92/8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62632,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_9b0c5ed929b5811451179985643356d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92/8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_d5e67a6425885dedee10f842932779ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92/8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_377d19c717d62f93c8fa4f339b17fd00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92/8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66463,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_8b27a252833780159c7ad792a161cdaa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92/8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60029,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_f660b1b27b4cd555fc6361038b122ca4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92/8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2373077,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_10c9ea63468f79accb6b2f35c1e711e5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92/8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70619,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_9dbb77b48c376ea088c86313c2dd5dba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92/8dde8c1d-0b01-5b73-a70b-6bb8f3c60b92_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86187,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/d4/16d454457928a0591dd0fc4b9b37536a/pa/NL69056_078009d47f81f721bf4e72b47396f636.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-27',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500C 0.9 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2018}
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL69056%27 HTTP/1.1" 200 None
2026-03-30 11:27:11 [auto1.fr] INFO: Saving data for NL69056: {'created_time': 1774870031.477172, 'last_price_update_time': 1774870031.477184, 'auction_closing_time': 1774970087.0}
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NL69056') HTTP/1.1" 204 0
2026-03-30 11:27:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DB80908> (referer: https://www.auto1.com/v1/car-details-view/DB80908/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da1c5b27-f194-5977-911d-687324f18684 with identifier: DB80908
2026-03-30 11:27:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da1c5b27-f194-5977-911d-687324f18684 with scrape type 1
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da1c5b27-f194-5977-911d-687324f18684
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F7d%252F937d89a79f4cdcf919c2bce48e3e0e34%252Fpa%252FDB80908_98e946f94bfd0fa40e9ccf5686960e6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_98e946f94bfd0fa40e9ccf5686960e6a.jpg not downloaded yet
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F7d%252F937d89a79f4cdcf919c2bce48e3e0e34%252Fpa%252FDB80908_9ffde818982f1c21fe2ae17911f14dc8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_9ffde818982f1c21fe2ae17911f14dc8.jpg not downloaded yet
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F7d%252F937d89a79f4cdcf919c2bce48e3e0e34%252Fpa%252FDB80908_9b3fa9fea49ccbf6be4a4e2fecc74fdb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_9b3fa9fea49ccbf6be4a4e2fecc74fdb.jpg not downloaded yet
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F7d%252F937d89a79f4cdcf919c2bce48e3e0e34%252Fpa%252FDB80908_557eeb0ee1815c4977a5b7ac681f9811.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_557eeb0ee1815c4977a5b7ac681f9811.jpg not downloaded yet
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F7d%252F937d89a79f4cdcf919c2bce48e3e0e34%252Fpa%252FDB80908_2b7660bf76b2b2767bfe8cda534de228.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_2b7660bf76b2b2767bfe8cda534de228.jpg not downloaded yet
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F7d%252F937d89a79f4cdcf919c2bce48e3e0e34%252Fpa%252FDB80908_906966bcbb9fcf57453f6150654ed60b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_906966bcbb9fcf57453f6150654ed60b.jpg not downloaded yet
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F7d%252F937d89a79f4cdcf919c2bce48e3e0e34%252Fpa%252FDB80908_319954ece7765ce894bfc13d75a431d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_319954ece7765ce894bfc13d75a431d6.jpg not downloaded yet
2026-03-30 11:27:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_98e946f94bfd0fa40e9ccf5686960e6a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_9ffde818982f1c21fe2ae17911f14dc8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F7d%252F937d89a79f4cdcf919c2bce48e3e0e34%252Fpa%252FDB80908_49e83f7ec11133ac3c448cf15560639d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_49e83f7ec11133ac3c448cf15560639d.jpg not downloaded yet
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F7d%252F937d89a79f4cdcf919c2bce48e3e0e34%252Fpa%252FDB80908_6e1a8c72006c4b469fa0f87237f68d2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_6e1a8c72006c4b469fa0f87237f68d2a.jpg not downloaded yet
2026-03-30 11:27:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_9b3fa9fea49ccbf6be4a4e2fecc74fdb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_557eeb0ee1815c4977a5b7ac681f9811.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F7d%252F937d89a79f4cdcf919c2bce48e3e0e34%252Fpa%252FDB80908_84dac0f705d1644d7b5ea40631ad341e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_84dac0f705d1644d7b5ea40631ad341e.jpg not downloaded yet
2026-03-30 11:27:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_49e83f7ec11133ac3c448cf15560639d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_2b7660bf76b2b2767bfe8cda534de228.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_84dac0f705d1644d7b5ea40631ad341e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_6e1a8c72006c4b469fa0f87237f68d2a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383dcd10>
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da1c5b27-f194-5977-911d-687324f18684/da1c5b27-f194-5977-911d-687324f18684_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F7d%252F937d89a79f4cdcf919c2bce48e3e0e34%252Fpa%252FDB80908_98e946f94bfd0fa40e9ccf5686960e6a.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_98e946f94bfd0fa40e9ccf5686960e6a.jpg saved to cache
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da1c5b27-f194-5977-911d-687324f18684
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07385a8bd0>
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da1c5b27-f194-5977-911d-687324f18684/da1c5b27-f194-5977-911d-687324f18684_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F7d%252F937d89a79f4cdcf919c2bce48e3e0e34%252Fpa%252FDB80908_9ffde818982f1c21fe2ae17911f14dc8.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_9ffde818982f1c21fe2ae17911f14dc8.jpg saved to cache
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da1c5b27-f194-5977-911d-687324f18684
2026-03-30 11:27:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_906966bcbb9fcf57453f6150654ed60b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_319954ece7765ce894bfc13d75a431d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a8ad790>
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da1c5b27-f194-5977-911d-687324f18684/da1c5b27-f194-5977-911d-687324f18684_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F7d%252F937d89a79f4cdcf919c2bce48e3e0e34%252Fpa%252FDB80908_9b3fa9fea49ccbf6be4a4e2fecc74fdb.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_9b3fa9fea49ccbf6be4a4e2fecc74fdb.jpg saved to cache
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da1c5b27-f194-5977-911d-687324f18684
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383b1fd0>
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da1c5b27-f194-5977-911d-687324f18684/da1c5b27-f194-5977-911d-687324f18684_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F7d%252F937d89a79f4cdcf919c2bce48e3e0e34%252Fpa%252FDB80908_557eeb0ee1815c4977a5b7ac681f9811.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_557eeb0ee1815c4977a5b7ac681f9811.jpg saved to cache
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da1c5b27-f194-5977-911d-687324f18684
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073856ced0>
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da1c5b27-f194-5977-911d-687324f18684/da1c5b27-f194-5977-911d-687324f18684_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F7d%252F937d89a79f4cdcf919c2bce48e3e0e34%252Fpa%252FDB80908_49e83f7ec11133ac3c448cf15560639d.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_49e83f7ec11133ac3c448cf15560639d.jpg saved to cache
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da1c5b27-f194-5977-911d-687324f18684
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073857eb10>
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da1c5b27-f194-5977-911d-687324f18684/da1c5b27-f194-5977-911d-687324f18684_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F7d%252F937d89a79f4cdcf919c2bce48e3e0e34%252Fpa%252FDB80908_2b7660bf76b2b2767bfe8cda534de228.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_2b7660bf76b2b2767bfe8cda534de228.jpg saved to cache
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da1c5b27-f194-5977-911d-687324f18684
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383c4d50>
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da1c5b27-f194-5977-911d-687324f18684/da1c5b27-f194-5977-911d-687324f18684_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F7d%252F937d89a79f4cdcf919c2bce48e3e0e34%252Fpa%252FDB80908_84dac0f705d1644d7b5ea40631ad341e.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_84dac0f705d1644d7b5ea40631ad341e.jpg saved to cache
2026-03-30 11:27:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item da1c5b27-f194-5977-911d-687324f18684
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a7e76d0>
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da1c5b27-f194-5977-911d-687324f18684/da1c5b27-f194-5977-911d-687324f18684_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:27:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F7d%252F937d89a79f4cdcf919c2bce48e3e0e34%252Fpa%252FDB80908_6e1a8c72006c4b469fa0f87237f68d2a.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_6e1a8c72006c4b469fa0f87237f68d2a.jpg saved to cache
2026-03-30 11:27:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item da1c5b27-f194-5977-911d-687324f18684
2026-03-30 11:27:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a7e5a90>
2026-03-30 11:27:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da1c5b27-f194-5977-911d-687324f18684/da1c5b27-f194-5977-911d-687324f18684_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:27:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F7d%252F937d89a79f4cdcf919c2bce48e3e0e34%252Fpa%252FDB80908_906966bcbb9fcf57453f6150654ed60b.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_906966bcbb9fcf57453f6150654ed60b.jpg saved to cache
2026-03-30 11:27:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da1c5b27-f194-5977-911d-687324f18684
2026-03-30 11:27:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383d8590>
2026-03-30 11:27:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da1c5b27-f194-5977-911d-687324f18684/da1c5b27-f194-5977-911d-687324f18684_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:27:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F7d%252F937d89a79f4cdcf919c2bce48e3e0e34%252Fpa%252FDB80908_319954ece7765ce894bfc13d75a431d6.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_319954ece7765ce894bfc13d75a431d6.jpg saved to cache
2026-03-30 11:27:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da1c5b27-f194-5977-911d-687324f18684
2026-03-30 11:27:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da1c5b27-f194-5977-911d-687324f18684, skipping ID generation
2026-03-30 11:27:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da1c5b27-f194-5977-911d-687324f18684 with scrape type 1
2026-03-30 11:27:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da1c5b27-f194-5977-911d-687324f18684 sending to next pipeline
2026-03-30 11:27:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: da1c5b27-f194-5977-911d-687324f18684, identifier: DB80908
2026-03-30 11:27:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: da1c5b27-f194-5977-911d-687324f18684 with identifier: DB80908
2026-03-30 11:27:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: da1c5b27-f194-5977-911d-687324f18684 with identifier: DB80908
2026-03-30 11:27:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: da1c5b27-f194-5977-911d-687324f18684 with identifier: DB80908 to the API
2026-03-30 11:27:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_319954ece7765ce894bfc13d75a431d6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 173,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.2L',
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:15:06Z',
'fuel_type': 'diesel',
'id': 'da1c5b27-f194-5977-911d-687324f18684',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB80908',
'listing': 'auction',
'location': 'FR, Marsannay-la-Côte',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 185131,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1c5b27-f194-5977-911d-687324f18684/da1c5b27-f194-5977-911d-687324f18684_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65938,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_98e946f94bfd0fa40e9ccf5686960e6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1c5b27-f194-5977-911d-687324f18684/da1c5b27-f194-5977-911d-687324f18684_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61326,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_9ffde818982f1c21fe2ae17911f14dc8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1c5b27-f194-5977-911d-687324f18684/da1c5b27-f194-5977-911d-687324f18684_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63465,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_9b3fa9fea49ccbf6be4a4e2fecc74fdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1c5b27-f194-5977-911d-687324f18684/da1c5b27-f194-5977-911d-687324f18684_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_557eeb0ee1815c4977a5b7ac681f9811.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1c5b27-f194-5977-911d-687324f18684/da1c5b27-f194-5977-911d-687324f18684_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_2b7660bf76b2b2767bfe8cda534de228.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1c5b27-f194-5977-911d-687324f18684/da1c5b27-f194-5977-911d-687324f18684_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58316,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_906966bcbb9fcf57453f6150654ed60b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1c5b27-f194-5977-911d-687324f18684/da1c5b27-f194-5977-911d-687324f18684_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52829,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_319954ece7765ce894bfc13d75a431d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1c5b27-f194-5977-911d-687324f18684/da1c5b27-f194-5977-911d-687324f18684_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_49e83f7ec11133ac3c448cf15560639d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1c5b27-f194-5977-911d-687324f18684/da1c5b27-f194-5977-911d-687324f18684_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_6e1a8c72006c4b469fa0f87237f68d2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1c5b27-f194-5977-911d-687324f18684/da1c5b27-f194-5977-911d-687324f18684_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62646,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/7d/937d89a79f4cdcf919c2bce48e3e0e34/pa/DB80908_84dac0f705d1644d7b5ea40631ad341e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-04-01',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota RAV 4 2.2 Turbodiesel Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2008}
2026-03-30 11:27:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB80908%27 HTTP/1.1" 200 None
2026-03-30 11:27:17 [auto1.fr] INFO: Saving data for DB80908: {'created_time': 1774870037.67463, 'last_price_update_time': 1774870037.674641, 'auction_closing_time': 1774970106.0}
2026-03-30 11:27:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DB80908') HTTP/1.1" 204 0
2026-03-30 11:27:26 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.972(s), this was the 1st time calling it.
2026-03-30 11:27:26 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.8036677243920085 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:27:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:31 [auto1.fr] INFO: Channel: 24h | Page: 23 | totalHits: 5592 | hits on page: 40
2026-03-30 11:27:31 [auto1.fr] INFO: Found listing with ID: SM15350
2026-03-30 11:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM15350%27 HTTP/1.1" 200 None
2026-03-30 11:27:31 [auto1.fr] INFO: Scrape type for SM15350: 0
2026-03-30 11:27:31 [auto1.fr] INFO: Found listing with ID: TX11821
2026-03-30 11:27:31 [auto1.fr] INFO: Found listing with ID: PV35629
2026-03-30 11:27:31 [auto1.fr] INFO: Found listing with ID: XP85932
2026-03-30 11:27:31 [auto1.fr] INFO: Found listing with ID: NN99848
2026-03-30 11:27:31 [auto1.fr] INFO: Found listing with ID: SS89133
2026-03-30 11:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS89133%27 HTTP/1.1" 200 None
2026-03-30 11:27:31 [auto1.fr] INFO: Scrape type for SS89133: 0
2026-03-30 11:27:31 [auto1.fr] INFO: Found listing with ID: VT37001
2026-03-30 11:27:31 [auto1.fr] INFO: Found listing with ID: ZN87379
2026-03-30 11:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN87379%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [auto1.fr] INFO: Scrape type for ZN87379: 0
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: NV27506
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV27506%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [auto1.fr] INFO: Scrape type for NV27506: 0
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: GV52982
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: BN28756
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: AD91227
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: ZC95968
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: XK83942
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: XK81760
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: EH51062
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: JY76757
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: AX22473
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX22473%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [auto1.fr] INFO: Scrape type for AX22473: 0
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: MZ41837
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ41837%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [auto1.fr] INFO: Scrape type for MZ41837: 0
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: EF10438
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: XL94041
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: YA21876
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: RN15222
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN15222%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [auto1.fr] INFO: Scrape type for RN15222: 0
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: LP16968
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: GG22552
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: RB04706
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: NN01775
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: CU28394
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: JK29705
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK29705%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [auto1.fr] INFO: Scrape type for JK29705: 0
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: SR20214
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: LT76736
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT76736%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [auto1.fr] INFO: Scrape type for LT76736: 0
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: LB48009
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB48009%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [auto1.fr] INFO: Scrape type for LB48009: 0
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: KH84545
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: VF20612
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: TG26507
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: NV80033
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: KJ05424
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: GF80669
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: MD03951
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD03951%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [auto1.fr] INFO: Scrape type for MD03951: 0
2026-03-30 11:27:32 [auto1.fr] INFO: Found listing with ID: XP99731
2026-03-30 11:27:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:27:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:38 [auto1.fr] INFO: Channel: 24h | Page: 24 | totalHits: 5594 | hits on page: 40
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: MD03951
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD03951%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for MD03951: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: XP99731
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: HC61208
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: VM65091
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: WY28346
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: RM38030
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: RB12134
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: BD87596
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD87596%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for BD87596: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: DK47228
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: KA87751
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA87751%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for KA87751: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: JA17926
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: VM16147
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VM16147%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for VM16147: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: ER22788
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: KH57146
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH57146%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for KH57146: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: ZG90152
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: CP15038
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: WD39316
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: FE06802
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE06802%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for FE06802: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: KA87239
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: FR98174
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: PG03000
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PG03000%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for PG03000: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: MB18852
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: GS75094
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: ET15310
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: BX78480
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX78480%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for BX78480: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: CJ89974
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: WP13025
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: HV51188
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV51188%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for HV51188: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: ML28729
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: BM94017
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM94017%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for BM94017: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: KR98838
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: CP37955
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: LJ18319
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ18319%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for LJ18319: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: GR98034
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: MK42469
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: SL62587
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: PC27087
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: ZP95502
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP95502%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for ZP95502: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: YT36285
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: XR02166
2026-03-30 11:27:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:40 [auto1.fr] INFO: Channel: 24h | Page: 25 | totalHits: 5594 | hits on page: 40
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: BV69061
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV69061%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.fr] INFO: Scrape type for BV69061: 0
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: UC77970
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: DH30848
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: CN53755
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: MR83440
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR83440%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.fr] INFO: Scrape type for MR83440: 0
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: BK72121
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: KH85386
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: DH64426
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: NJ39357
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ39357%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.fr] INFO: Scrape type for NJ39357: 0
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: VC57641
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: TY69433
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: NG03536
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: EL57210
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: BR79428
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: FP49208
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: VS37711
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: SF00257
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: JU81285
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: KT15244
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: GN02112
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: KJ82390
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: DN05636
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DN05636%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.fr] INFO: Scrape type for DN05636: 0
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: EV63004
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: BZ54186
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: DJ58290
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: DX45828
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DX45828%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.fr] INFO: Scrape type for DX45828: 0
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: RH58772
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: VZ61146
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: MB07680
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: PV49045
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: FV37446
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV37446%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.fr] INFO: Scrape type for FV37446: 0
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: TP09076
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: EG55368
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG55368%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.fr] INFO: Scrape type for EG55368: 0
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: YK96178
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: RX28214
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: MM01049
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM01049%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.fr] INFO: Scrape type for MM01049: 0
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: TU22359
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU22359%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.fr] INFO: Scrape type for TU22359: 0
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: SV83520
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: ZU71183
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU71183%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.fr] INFO: Scrape type for ZU71183: 0
2026-03-30 11:27:40 [auto1.fr] INFO: Found listing with ID: JZ88534
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ88534%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.fr] INFO: Scrape type for JZ88534: 0
2026-03-30 11:27:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX65836> (referer: https://www.auto1.com/v1/car-details-view/LX65836/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d7ac383-4581-59e1-b6c2-5523cb8346e2 with identifier: LX65836
2026-03-30 11:27:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d7ac383-4581-59e1-b6c2-5523cb8346e2 with scrape type 1
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5d7ac383-4581-59e1-b6c2-5523cb8346e2
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F48%252Fef48088218ef0daf0619bab20dd7e434%252Fpa%252FLX65836_cf56c6c137e4402189038ac76315c5a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_cf56c6c137e4402189038ac76315c5a4.jpg not downloaded yet
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F48%252Fef48088218ef0daf0619bab20dd7e434%252Fpa%252FLX65836_4bdd0ab16e2d7d6a44bf4fafc4deb994.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_4bdd0ab16e2d7d6a44bf4fafc4deb994.jpg not downloaded yet
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F48%252Fef48088218ef0daf0619bab20dd7e434%252Fpa%252FLX65836_a62cd8017c440d44b1e201f297bc5ef1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_a62cd8017c440d44b1e201f297bc5ef1.jpg not downloaded yet
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F48%252Fef48088218ef0daf0619bab20dd7e434%252Fpa%252FLX65836_39b1999e97733ff630755b4dca390466.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_39b1999e97733ff630755b4dca390466.jpg not downloaded yet
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F48%252Fef48088218ef0daf0619bab20dd7e434%252Fpa%252FLX65836_771015dd155d2f758d5014384761ad66.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_771015dd155d2f758d5014384761ad66.jpg not downloaded yet
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F48%252Fef48088218ef0daf0619bab20dd7e434%252Fpa%252FLX65836_4dd117cb37c4dacb94302e0d7ca57aae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_4dd117cb37c4dacb94302e0d7ca57aae.jpg not downloaded yet
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F48%252Fef48088218ef0daf0619bab20dd7e434%252Fpa%252FLX65836_193ea1a93332606f110a3d267be348c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_193ea1a93332606f110a3d267be348c2.jpg not downloaded yet
2026-03-30 11:27:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_4bdd0ab16e2d7d6a44bf4fafc4deb994.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_cf56c6c137e4402189038ac76315c5a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F48%252Fef48088218ef0daf0619bab20dd7e434%252Fpa%252FLX65836_b829c35de329aa18ba4db1d2421b2af1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_b829c35de329aa18ba4db1d2421b2af1.jpg not downloaded yet
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F48%252Fef48088218ef0daf0619bab20dd7e434%252Fpa%252FLX65836_67bc4ba0d15ca084e4069c9e41342159.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_67bc4ba0d15ca084e4069c9e41342159.jpg not downloaded yet
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F48%252Fef48088218ef0daf0619bab20dd7e434%252Fpa%252FLX65836_b036991bbdcf20d02e34db8d44657720.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_b036991bbdcf20d02e34db8d44657720.jpg not downloaded yet
2026-03-30 11:27:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_771015dd155d2f758d5014384761ad66.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_a62cd8017c440d44b1e201f297bc5ef1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_4dd117cb37c4dacb94302e0d7ca57aae.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_193ea1a93332606f110a3d267be348c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_b036991bbdcf20d02e34db8d44657720.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738788bd0>
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7ac383-4581-59e1-b6c2-5523cb8346e2/5d7ac383-4581-59e1-b6c2-5523cb8346e2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F48%252Fef48088218ef0daf0619bab20dd7e434%252Fpa%252FLX65836_4bdd0ab16e2d7d6a44bf4fafc4deb994.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_4bdd0ab16e2d7d6a44bf4fafc4deb994.jpg saved to cache
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d7ac383-4581-59e1-b6c2-5523cb8346e2
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a7e3010>
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7ac383-4581-59e1-b6c2-5523cb8346e2/5d7ac383-4581-59e1-b6c2-5523cb8346e2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F48%252Fef48088218ef0daf0619bab20dd7e434%252Fpa%252FLX65836_cf56c6c137e4402189038ac76315c5a4.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_cf56c6c137e4402189038ac76315c5a4.jpg saved to cache
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d7ac383-4581-59e1-b6c2-5523cb8346e2
2026-03-30 11:27:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_b829c35de329aa18ba4db1d2421b2af1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073871d650>
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7ac383-4581-59e1-b6c2-5523cb8346e2/5d7ac383-4581-59e1-b6c2-5523cb8346e2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F48%252Fef48088218ef0daf0619bab20dd7e434%252Fpa%252FLX65836_771015dd155d2f758d5014384761ad66.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_771015dd155d2f758d5014384761ad66.jpg saved to cache
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5d7ac383-4581-59e1-b6c2-5523cb8346e2
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738722b50>
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7ac383-4581-59e1-b6c2-5523cb8346e2/5d7ac383-4581-59e1-b6c2-5523cb8346e2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F48%252Fef48088218ef0daf0619bab20dd7e434%252Fpa%252FLX65836_a62cd8017c440d44b1e201f297bc5ef1.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_a62cd8017c440d44b1e201f297bc5ef1.jpg saved to cache
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d7ac383-4581-59e1-b6c2-5523cb8346e2
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073a8bb150>
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7ac383-4581-59e1-b6c2-5523cb8346e2/5d7ac383-4581-59e1-b6c2-5523cb8346e2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F48%252Fef48088218ef0daf0619bab20dd7e434%252Fpa%252FLX65836_4dd117cb37c4dacb94302e0d7ca57aae.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_4dd117cb37c4dacb94302e0d7ca57aae.jpg saved to cache
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5d7ac383-4581-59e1-b6c2-5523cb8346e2
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073860c750>
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7ac383-4581-59e1-b6c2-5523cb8346e2/5d7ac383-4581-59e1-b6c2-5523cb8346e2_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F48%252Fef48088218ef0daf0619bab20dd7e434%252Fpa%252FLX65836_193ea1a93332606f110a3d267be348c2.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_193ea1a93332606f110a3d267be348c2.jpg saved to cache
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5d7ac383-4581-59e1-b6c2-5523cb8346e2
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f073860bdd0>
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7ac383-4581-59e1-b6c2-5523cb8346e2/5d7ac383-4581-59e1-b6c2-5523cb8346e2_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F48%252Fef48088218ef0daf0619bab20dd7e434%252Fpa%252FLX65836_b036991bbdcf20d02e34db8d44657720.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_b036991bbdcf20d02e34db8d44657720.jpg saved to cache
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5d7ac383-4581-59e1-b6c2-5523cb8346e2
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0738536290>
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7ac383-4581-59e1-b6c2-5523cb8346e2/5d7ac383-4581-59e1-b6c2-5523cb8346e2_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F48%252Fef48088218ef0daf0619bab20dd7e434%252Fpa%252FLX65836_b829c35de329aa18ba4db1d2421b2af1.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_b829c35de329aa18ba4db1d2421b2af1.jpg saved to cache
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5d7ac383-4581-59e1-b6c2-5523cb8346e2
2026-03-30 11:27:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_67bc4ba0d15ca084e4069c9e41342159.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_39b1999e97733ff630755b4dca390466.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383b2290>
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7ac383-4581-59e1-b6c2-5523cb8346e2/5d7ac383-4581-59e1-b6c2-5523cb8346e2_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F48%252Fef48088218ef0daf0619bab20dd7e434%252Fpa%252FLX65836_67bc4ba0d15ca084e4069c9e41342159.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_67bc4ba0d15ca084e4069c9e41342159.jpg saved to cache
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5d7ac383-4581-59e1-b6c2-5523cb8346e2
2026-03-30 11:27:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07383f7e90>
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7ac383-4581-59e1-b6c2-5523cb8346e2/5d7ac383-4581-59e1-b6c2-5523cb8346e2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F48%252Fef48088218ef0daf0619bab20dd7e434%252Fpa%252FLX65836_39b1999e97733ff630755b4dca390466.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_39b1999e97733ff630755b4dca390466.jpg saved to cache
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d7ac383-4581-59e1-b6c2-5523cb8346e2
2026-03-30 11:27:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d7ac383-4581-59e1-b6c2-5523cb8346e2, skipping ID generation
2026-03-30 11:27:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d7ac383-4581-59e1-b6c2-5523cb8346e2 with scrape type 1
2026-03-30 11:27:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d7ac383-4581-59e1-b6c2-5523cb8346e2 sending to next pipeline
2026-03-30 11:27:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5d7ac383-4581-59e1-b6c2-5523cb8346e2, identifier: LX65836
2026-03-30 11:27:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5d7ac383-4581-59e1-b6c2-5523cb8346e2 with identifier: LX65836
2026-03-30 11:27:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5d7ac383-4581-59e1-b6c2-5523cb8346e2 with identifier: LX65836
2026-03-30 11:27:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5d7ac383-4581-59e1-b6c2-5523cb8346e2 with identifier: LX65836 to the API
2026-03-30 11:27:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_39b1999e97733ff630755b4dca390466.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:43:15Z',
'fuel_type': 'diesel',
'id': '5d7ac383-4581-59e1-b6c2-5523cb8346e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX65836',
'listing': 'auction',
'location': 'FR, Puget-sur-Argens',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 206935,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7ac383-4581-59e1-b6c2-5523cb8346e2/5d7ac383-4581-59e1-b6c2-5523cb8346e2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73160,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_cf56c6c137e4402189038ac76315c5a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7ac383-4581-59e1-b6c2-5523cb8346e2/5d7ac383-4581-59e1-b6c2-5523cb8346e2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64608,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_4bdd0ab16e2d7d6a44bf4fafc4deb994.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7ac383-4581-59e1-b6c2-5523cb8346e2/5d7ac383-4581-59e1-b6c2-5523cb8346e2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71032,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_a62cd8017c440d44b1e201f297bc5ef1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7ac383-4581-59e1-b6c2-5523cb8346e2/5d7ac383-4581-59e1-b6c2-5523cb8346e2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2762977,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_39b1999e97733ff630755b4dca390466.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7ac383-4581-59e1-b6c2-5523cb8346e2/5d7ac383-4581-59e1-b6c2-5523cb8346e2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_771015dd155d2f758d5014384761ad66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7ac383-4581-59e1-b6c2-5523cb8346e2/5d7ac383-4581-59e1-b6c2-5523cb8346e2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_4dd117cb37c4dacb94302e0d7ca57aae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7ac383-4581-59e1-b6c2-5523cb8346e2/5d7ac383-4581-59e1-b6c2-5523cb8346e2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_193ea1a93332606f110a3d267be348c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7ac383-4581-59e1-b6c2-5523cb8346e2/5d7ac383-4581-59e1-b6c2-5523cb8346e2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71056,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_b829c35de329aa18ba4db1d2421b2af1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7ac383-4581-59e1-b6c2-5523cb8346e2/5d7ac383-4581-59e1-b6c2-5523cb8346e2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64568,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_67bc4ba0d15ca084e4069c9e41342159.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7ac383-4581-59e1-b6c2-5523cb8346e2/5d7ac383-4581-59e1-b6c2-5523cb8346e2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85086,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/48/ef48088218ef0daf0619bab20dd7e434/pa/LX65836_b036991bbdcf20d02e34db8d44657720.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-09-14',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDI',
'transmission': 'manual',
'trim': '',
'year': 2016}
2026-03-30 11:27:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX65836%27 HTTP/1.1" 200 None
2026-03-30 11:27:42 [auto1.fr] INFO: Saving data for LX65836: {'created_time': 1774870062.560928, 'last_price_update_time': 1774870062.560938, 'auction_closing_time': 1774971795.0}
2026-03-30 11:27:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LX65836') HTTP/1.1" 204 0
2026-03-30 11:27:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:53 [auto1.fr] INFO: Channel: 24h | Page: 26 | totalHits: 5594 | hits on page: 40
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: TL43630
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL43630%27 HTTP/1.1" 200 None
2026-03-30 11:27:53 [auto1.fr] INFO: Scrape type for TL43630: 0
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: XL92817
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: TC56491
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: NV76103
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV76103%27 HTTP/1.1" 200 None
2026-03-30 11:27:53 [auto1.fr] INFO: Scrape type for NV76103: 0
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: KV21640
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: KB61906
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: PA77686
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: SY29297
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SY29297%27 HTTP/1.1" 200 None
2026-03-30 11:27:53 [auto1.fr] INFO: Scrape type for SY29297: 0
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: CF60384
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF60384%27 HTTP/1.1" 200 None
2026-03-30 11:27:53 [auto1.fr] INFO: Scrape type for CF60384: 0
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: BX52558
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX52558%27 HTTP/1.1" 200 None
2026-03-30 11:27:53 [auto1.fr] INFO: Scrape type for BX52558: 0
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: HM35105
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HM35105%27 HTTP/1.1" 200 None
2026-03-30 11:27:53 [auto1.fr] INFO: Scrape type for HM35105: 0
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: HS81476
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS81476%27 HTTP/1.1" 200 None
2026-03-30 11:27:53 [auto1.fr] INFO: Scrape type for HS81476: 0
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: TT94112
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: ZU29510
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: SX04652
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX04652%27 HTTP/1.1" 200 None
2026-03-30 11:27:53 [auto1.fr] INFO: Scrape type for SX04652: 0
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: BK23856
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK23856%27 HTTP/1.1" 200 None
2026-03-30 11:27:53 [auto1.fr] INFO: Scrape type for BK23856: 0
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: DT54800
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: PX14877
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: UR06829
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: TA74732
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA74732%27 HTTP/1.1" 200 None
2026-03-30 11:27:53 [auto1.fr] INFO: Scrape type for TA74732: 0
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: LD13478
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: GD92514
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: DL24790
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: FV10697
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: TU46522
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: CM07289
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: XG30202
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: AL74013
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: VS30684
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS30684%27 HTTP/1.1" 200 None
2026-03-30 11:27:53 [auto1.fr] INFO: Scrape type for VS30684: 0
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: TN98594
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: FX72814
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: EC55821
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: JJ80448
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ80448%27 HTTP/1.1" 200 None
2026-03-30 11:27:53 [auto1.fr] INFO: Scrape type for JJ80448: 0
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: MJ43566
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: ZZ19761
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: NS56484
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS56484%27 HTTP/1.1" 200 None
2026-03-30 11:27:53 [auto1.fr] INFO: Scrape type for NS56484: 0
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: UZ78191
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: GR61554
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: RD55039
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD55039%27 HTTP/1.1" 200 None
2026-03-30 11:27:53 [auto1.fr] INFO: Scrape type for RD55039: 0
2026-03-30 11:27:53 [auto1.fr] INFO: Found listing with ID: SU67266
2026-03-30 11:27:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:01 [auto1.fr] INFO: Channel: 24h | Page: 27 | totalHits: 5594 | hits on page: 40
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: TY27143
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY27143%27 HTTP/1.1" 200 None
2026-03-30 11:28:01 [auto1.fr] INFO: Scrape type for TY27143: 0
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: CF24077
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: TW89495
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: GM82732
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: JR89101
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: PE76789
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: TM96159
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: EW80890
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: LA42071
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: NK60668
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: JC04729
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: WU38484
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: CH43272
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: BE87790
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: UL81175
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL81175%27 HTTP/1.1" 200 None
2026-03-30 11:28:01 [auto1.fr] INFO: Scrape type for UL81175: 0
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: PH43278
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: PG45287
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: XN84792
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: GU38048
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: LY30069
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: ZG81108
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: ZV53128
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: JA85521
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: NN44286
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN44286%27 HTTP/1.1" 200 None
2026-03-30 11:28:01 [auto1.fr] INFO: Scrape type for NN44286: 0
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: YF90779
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: ZJ95567
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: FS13979
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: EG04160
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG04160%27 HTTP/1.1" 200 None
2026-03-30 11:28:01 [auto1.fr] INFO: Scrape type for EG04160: 0
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: TF56803
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: BK02644
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: KV99093
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: XP51935
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: ZH33585
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: BE56161
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: KG84776
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: RP02904
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: KV37155
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: RD69787
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: XP70683
2026-03-30 11:28:01 [auto1.fr] INFO: Found listing with ID: TV40287
2026-03-30 11:28:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:03 [auto1.fr] INFO: Channel: 24h | Page: 28 | totalHits: 5594 | hits on page: 40
2026-03-30 11:28:03 [auto1.fr] INFO: Found listing with ID: MV30877
2026-03-30 11:28:03 [auto1.fr] INFO: Found listing with ID: YD24944
2026-03-30 11:28:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YD24944%27 HTTP/1.1" 200 None
2026-03-30 11:28:03 [auto1.fr] INFO: Scrape type for YD24944: 0
2026-03-30 11:28:03 [auto1.fr] INFO: Found listing with ID: UB44080
2026-03-30 11:28:03 [auto1.fr] INFO: Found listing with ID: CY41732
2026-03-30 11:28:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY41732%27 HTTP/1.1" 200 None
2026-03-30 11:28:03 [auto1.fr] INFO: Scrape type for CY41732: 0
2026-03-30 11:28:03 [auto1.fr] INFO: Found listing with ID: JX53268
2026-03-30 11:28:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX53268%27 HTTP/1.1" 200 None
2026-03-30 11:28:03 [auto1.fr] INFO: Scrape type for JX53268: 0
2026-03-30 11:28:03 [auto1.fr] INFO: Found listing with ID: VJ25498
2026-03-30 11:28:03 [auto1.fr] INFO: Found listing with ID: PH34253
2026-03-30 11:28:03 [auto1.fr] INFO: Found listing with ID: ZY67756
2026-03-30 11:28:03 [auto1.fr] INFO: Found listing with ID: WE41857
2026-03-30 11:28:03 [auto1.fr] INFO: Found listing with ID: HL16171
2026-03-30 11:28:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL16171%27 HTTP/1.1" 200 None
2026-03-30 11:28:03 [auto1.fr] INFO: Scrape type for HL16171: 0
2026-03-30 11:28:03 [auto1.fr] INFO: Found listing with ID: BG53255
2026-03-30 11:28:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG53255%27 HTTP/1.1" 200 None
2026-03-30 11:28:03 [auto1.fr] INFO: Scrape type for BG53255: 0
2026-03-30 11:28:03 [auto1.fr] INFO: Found listing with ID: MK81616
2026-03-30 11:28:03 [auto1.fr] INFO: Found listing with ID: VL74516
2026-03-30 11:28:03 [auto1.fr] INFO: Found listing with ID: ZU60832
2026-03-30 11:28:03 [auto1.fr] INFO: Found listing with ID: UJ98371
2026-03-30 11:28:03 [auto1.fr] INFO: Found listing with ID: SA79253
2026-03-30 11:28:03 [auto1.fr] INFO: Found listing with ID: TP39004
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP39004%27 HTTP/1.1" 200 None
2026-03-30 11:28:04 [auto1.fr] INFO: Scrape type for TP39004: 0
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: VV06327
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: YV95357
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV95357%27 HTTP/1.1" 200 None
2026-03-30 11:28:04 [auto1.fr] INFO: Scrape type for YV95357: 0
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: CW97175
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: TZ76111
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: MR25927
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: EL79670
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: HF97027
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF97027%27 HTTP/1.1" 200 None
2026-03-30 11:28:04 [auto1.fr] INFO: Scrape type for HF97027: 0
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: DC78531
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC78531%27 HTTP/1.1" 200 None
2026-03-30 11:28:04 [auto1.fr] INFO: Scrape type for DC78531: 0
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: JC25064
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: HG95528
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: FX87997
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: FU18661
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: EE45585
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE45585%27 HTTP/1.1" 200 None
2026-03-30 11:28:04 [auto1.fr] INFO: Scrape type for EE45585: 0
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: UT20394
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: MX13044
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: EF63082
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: VX78818
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: AP09710
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: TT35591
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: RN36299
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: BH31485
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: ES02305
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: DA74552
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA74552%27 HTTP/1.1" 200 None
2026-03-30 11:28:04 [auto1.fr] INFO: Scrape type for DA74552: 0
2026-03-30 11:28:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:05 [scrapy.extensions.logstats] INFO: Crawled 271 pages (at 13 pages/min), scraped 209 items (at 6 items/min)
2026-03-30 11:28:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:28:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:23 [auto1.fr] INFO: Channel: 24h | Page: 29 | totalHits: 5595 | hits on page: 40
2026-03-30 11:28:23 [auto1.fr] INFO: Found listing with ID: DA74552
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA74552%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.fr] INFO: Scrape type for DA74552: 0
2026-03-30 11:28:23 [auto1.fr] INFO: Found listing with ID: EL93658
2026-03-30 11:28:23 [auto1.fr] INFO: Found listing with ID: MU42358
2026-03-30 11:28:23 [auto1.fr] INFO: Found listing with ID: BL12426
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL12426%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.fr] INFO: Scrape type for BL12426: 0
2026-03-30 11:28:23 [auto1.fr] INFO: Found listing with ID: WZ54212
2026-03-30 11:28:23 [auto1.fr] INFO: Found listing with ID: ZB04396
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB04396%27 HTTP/1.1" 200 None
2026-03-30 11:28:24 [auto1.fr] INFO: Scrape type for ZB04396: 0
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: MA06902
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: WM34767
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: MZ22730
2026-03-30 11:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ22730%27 HTTP/1.1" 200 None
2026-03-30 11:28:24 [auto1.fr] INFO: Scrape type for MZ22730: 0
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: GR12789
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: BR89045
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: DU77787
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: KH06244
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: AT01769
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: BT62919
2026-03-30 11:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT62919%27 HTTP/1.1" 200 None
2026-03-30 11:28:24 [auto1.fr] INFO: Scrape type for BT62919: 0
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: NY21368
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: XH36862
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: GU34103
2026-03-30 11:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU34103%27 HTTP/1.1" 200 None
2026-03-30 11:28:24 [auto1.fr] INFO: Scrape type for GU34103: 0
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: LW46673
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: ND89234
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: XS84278
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: DS91007
2026-03-30 11:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS91007%27 HTTP/1.1" 200 None
2026-03-30 11:28:24 [auto1.fr] INFO: Scrape type for DS91007: 0
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: GE11364
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: VY02503
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: TZ02960
2026-03-30 11:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ02960%27 HTTP/1.1" 200 None
2026-03-30 11:28:24 [auto1.fr] INFO: Scrape type for TZ02960: 0
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: NA76127
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: FZ19401
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: DU05349
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: MJ09819
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: PD24885
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: TL76456
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: EZ26130
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: BM92439
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: TS19753
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: BD67200
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: FR00063
2026-03-30 11:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FR00063%27 HTTP/1.1" 200 None
2026-03-30 11:28:24 [auto1.fr] INFO: Scrape type for FR00063: 0
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: CN82695
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: WL83691
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: JP18496
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: ZB66420
2026-03-30 11:28:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:35 [auto1.fr] INFO: Channel: 24h | Page: 30 | totalHits: 5596 | hits on page: 40
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: ZB66420
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: HA49256
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: RH62537
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: YY77064
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: PU50020
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: HL00485
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: EX77707
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: SZ69370
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: ZK36934
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: YN55052
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YN55052%27 HTTP/1.1" 200 None
2026-03-30 11:28:35 [auto1.fr] INFO: Scrape type for YN55052: 0
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: AB09197
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: LW26050
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: AP20381
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: CT46807
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: ED23855
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: HB74151
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB74151%27 HTTP/1.1" 200 None
2026-03-30 11:28:35 [auto1.fr] INFO: Scrape type for HB74151: 0
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: YF69984
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: PM43892
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: ZJ93568
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ93568%27 HTTP/1.1" 200 None
2026-03-30 11:28:35 [auto1.fr] INFO: Scrape type for ZJ93568: 0
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: EA40746
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: KG95545
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KG95545%27 HTTP/1.1" 200 None
2026-03-30 11:28:35 [auto1.fr] INFO: Scrape type for KG95545: 0
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: DL27365
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: LZ24855
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: LD43486
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: ZA49650
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA49650%27 HTTP/1.1" 200 None
2026-03-30 11:28:35 [auto1.fr] INFO: Scrape type for ZA49650: 0
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: GK39924
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: SU63674
2026-03-30 11:28:35 [auto1.fr] INFO: Found listing with ID: CA16747
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA16747%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.fr] INFO: Scrape type for CA16747: 0
2026-03-30 11:28:36 [auto1.fr] INFO: Found listing with ID: AR83930
2026-03-30 11:28:36 [auto1.fr] INFO: Found listing with ID: CA24685
2026-03-30 11:28:36 [auto1.fr] INFO: Found listing with ID: TD13797
2026-03-30 11:28:36 [auto1.fr] INFO: Found listing with ID: LY83162
2026-03-30 11:28:36 [auto1.fr] INFO: Found listing with ID: PK06687
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK06687%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.fr] INFO: Scrape type for PK06687: 0
2026-03-30 11:28:36 [auto1.fr] INFO: Found listing with ID: RM94276
2026-03-30 11:28:36 [auto1.fr] INFO: Found listing with ID: EG00883
2026-03-30 11:28:36 [auto1.fr] INFO: Found listing with ID: VT21499
2026-03-30 11:28:36 [auto1.fr] INFO: Found listing with ID: KM03386
2026-03-30 11:28:36 [auto1.fr] INFO: Found listing with ID: GF24817
2026-03-30 11:28:36 [auto1.fr] INFO: Found listing with ID: LM21992
2026-03-30 11:28:36 [auto1.fr] INFO: Found listing with ID: JU40978
2026-03-30 11:28:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.751(s), this was the 1st time calling it.
2026-03-30 11:28:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.552362040477126 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:28:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:43 [auto1.fr] INFO: Channel: 24h | Page: 31 | totalHits: 5597 | hits on page: 40
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: JU40978
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: MJ78206
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: MJ39952
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: UB50505
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: AX81873
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: JD11645
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: JZ73334
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: NF74996
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: BY79094
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: CY49772
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: ZP74906
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: UT28849
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: HZ48160
2026-03-30 11:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ48160%27 HTTP/1.1" 200 None
2026-03-30 11:28:43 [auto1.fr] INFO: Scrape type for HZ48160: 0
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: SD16900
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: WB70972
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: GC25257
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: AW19486
2026-03-30 11:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW19486%27 HTTP/1.1" 200 None
2026-03-30 11:28:43 [auto1.fr] INFO: Scrape type for AW19486: 0
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: JW96914
2026-03-30 11:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW96914%27 HTTP/1.1" 200 None
2026-03-30 11:28:43 [auto1.fr] INFO: Scrape type for JW96914: 0
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: BP70951
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: NF11596
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: WA51668
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: AA63271
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: DP52988
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: NV45480
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: XU13949
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: NJ53685
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: VX29417
2026-03-30 11:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX29417%27 HTTP/1.1" 200 None
2026-03-30 11:28:43 [auto1.fr] INFO: Scrape type for VX29417: 0
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: DD51792
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: UD43738
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: YB57255
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: TT51673
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: AP91610
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: MG48887
2026-03-30 11:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG48887%27 HTTP/1.1" 200 None
2026-03-30 11:28:43 [auto1.fr] INFO: Scrape type for MG48887: 0
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: FW94560
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: ZZ88049
2026-03-30 11:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ88049%27 HTTP/1.1" 200 None
2026-03-30 11:28:43 [auto1.fr] INFO: Scrape type for ZZ88049: 0
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: JD71808
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: ZP58765
2026-03-30 11:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP58765%27 HTTP/1.1" 200 None
2026-03-30 11:28:43 [auto1.fr] INFO: Scrape type for ZP58765: 0
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: HR66620
2026-03-30 11:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HR66620%27 HTTP/1.1" 200 None
2026-03-30 11:28:43 [auto1.fr] INFO: Scrape type for HR66620: 0
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: KY35521
2026-03-30 11:28:43 [auto1.fr] INFO: Found listing with ID: VN94368
2026-03-30 11:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN94368%27 HTTP/1.1" 200 None
2026-03-30 11:28:43 [auto1.fr] INFO: Scrape type for VN94368: 0
2026-03-30 11:28:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:28:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:47 [auto1.fr] INFO: Channel: 24h | Page: 32 | totalHits: 5597 | hits on page: 40
2026-03-30 11:28:47 [auto1.fr] INFO: Found listing with ID: SB34610
2026-03-30 11:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB34610%27 HTTP/1.1" 200 None
2026-03-30 11:28:47 [auto1.fr] INFO: Scrape type for SB34610: 0
2026-03-30 11:28:47 [auto1.fr] INFO: Found listing with ID: WD64082
2026-03-30 11:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD64082%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [auto1.fr] INFO: Scrape type for WD64082: 0
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: WM66922
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM66922%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [auto1.fr] INFO: Scrape type for WM66922: 0
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: XB39561
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: FD08548
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: RJ05241
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RJ05241%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [auto1.fr] INFO: Scrape type for RJ05241: 0
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: ZE84012
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: GP66530
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP66530%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [auto1.fr] INFO: Scrape type for GP66530: 0
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: YG18113
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: LL00787
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: TV66965
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV66965%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [auto1.fr] INFO: Scrape type for TV66965: 0
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: YF91947
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: CF64953
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF64953%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [auto1.fr] INFO: Scrape type for CF64953: 0
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: LX96530
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: VC72866
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC72866%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [auto1.fr] INFO: Scrape type for VC72866: 0
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: TA19729
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: AW72987
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: NX24565
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: JR54529
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: TJ20151
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ20151%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [auto1.fr] INFO: Scrape type for TJ20151: 0
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: EH91855
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH91855%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [auto1.fr] INFO: Scrape type for EH91855: 0
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: UP72076
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: CR64037
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: VP32926
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP32926%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [auto1.fr] INFO: Scrape type for VP32926: 0
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: SD52344
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: AH27666
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH27666%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [auto1.fr] INFO: Scrape type for AH27666: 0
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: BK72500
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: AD80452
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: VF51675
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: HF01727
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF01727%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [auto1.fr] INFO: Scrape type for HF01727: 0
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: NZ06649
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: GF46246
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: XJ44372
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: ZC86979
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZC86979%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [auto1.fr] INFO: Scrape type for ZC86979: 0
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: SG18598
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG18598%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [auto1.fr] INFO: Scrape type for SG18598: 0
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: JJ02643
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: AR69869
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: DA80805
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: MA97510
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA97510%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [auto1.fr] INFO: Scrape type for MA97510: 0
2026-03-30 11:28:48 [auto1.fr] INFO: Found listing with ID: KB64497
2026-03-30 11:28:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA06834> (referer: https://www.auto1.com/v1/car-details-view/UA06834/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98f0e40c-d576-55bd-97cd-dd8573915c42 with identifier: UA06834
2026-03-30 11:28:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98f0e40c-d576-55bd-97cd-dd8573915c42 with scrape type 1
2026-03-30 11:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98f0e40c-d576-55bd-97cd-dd8573915c42
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F7e%252Fcf7e3af7df6ba14f7685c52f7519bb5c%252Fpa%252FUA06834_ebd0f29ddcc1fc94bf0e0e73f6fe5a7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_ebd0f29ddcc1fc94bf0e0e73f6fe5a7e.jpg already downloaded
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F7e%252Fcf7e3af7df6ba14f7685c52f7519bb5c%252Fpa%252FUA06834_fbfff8198a46537cfd9a40a3cd59912d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_fbfff8198a46537cfd9a40a3cd59912d.jpg already downloaded
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F7e%252Fcf7e3af7df6ba14f7685c52f7519bb5c%252Fpa%252FUA06834_3f8ccdf3216ad951632d620f952813d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_3f8ccdf3216ad951632d620f952813d9.jpg already downloaded
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F7e%252Fcf7e3af7df6ba14f7685c52f7519bb5c%252Fpa%252FUA06834_e5bfef6d0ffb910ffa3d3429c9a74f25.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_e5bfef6d0ffb910ffa3d3429c9a74f25.jpg already downloaded
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F7e%252Fcf7e3af7df6ba14f7685c52f7519bb5c%252Fpa%252FUA06834_5b5f4ca241678a12cff210d98755daae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_5b5f4ca241678a12cff210d98755daae.jpg already downloaded
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F7e%252Fcf7e3af7df6ba14f7685c52f7519bb5c%252Fpa%252FUA06834_e76314c49e64152fb1eb4f25f8061d5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_e76314c49e64152fb1eb4f25f8061d5e.jpg already downloaded
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F7e%252Fcf7e3af7df6ba14f7685c52f7519bb5c%252Fpa%252FUA06834_5f319b9946b6fbc5ebba8897f664efa4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_5f319b9946b6fbc5ebba8897f664efa4.jpg already downloaded
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F7e%252Fcf7e3af7df6ba14f7685c52f7519bb5c%252Fpa%252FUA06834_bd0a51ee5ac75272488e52ec0d82b6e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_bd0a51ee5ac75272488e52ec0d82b6e8.jpg already downloaded
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F7e%252Fcf7e3af7df6ba14f7685c52f7519bb5c%252Fpa%252FUA06834_fbdb86adb97547599f9881480bb798b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_fbdb86adb97547599f9881480bb798b6.jpg already downloaded
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F7e%252Fcf7e3af7df6ba14f7685c52f7519bb5c%252Fpa%252FUA06834_6af1ba4ec0cece78812b777876c4e44b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_6af1ba4ec0cece78812b777876c4e44b.jpg already downloaded
2026-03-30 11:28:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 98f0e40c-d576-55bd-97cd-dd8573915c42, identifier: UA06834
2026-03-30 11:28:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 98f0e40c-d576-55bd-97cd-dd8573915c42 with identifier: UA06834
2026-03-30 11:28:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 98f0e40c-d576-55bd-97cd-dd8573915c42 with identifier: UA06834
2026-03-30 11:28:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 98f0e40c-d576-55bd-97cd-dd8573915c42 with identifier: UA06834 to the API
2026-03-30 11:28:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:28:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:28:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UA06834>
{'auction_title': '',
'c_o_2_emission_value': 169,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 170,
'expiration_date': '2026-03-31T15:11:15Z',
'fuel_type': 'diesel',
'id': '98f0e40c-d576-55bd-97cd-dd8573915c42',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA06834',
'listing': 'auction',
'location': 'FR, Saint Aignan de Grandlieu',
'make': 'Fiat',
'model': 'Freemont',
'odometer': 282393,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_ebd0f29ddcc1fc94bf0e0e73f6fe5a7e.jpg',
'https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_fbfff8198a46537cfd9a40a3cd59912d.jpg',
'https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_3f8ccdf3216ad951632d620f952813d9.jpg',
'https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_e5bfef6d0ffb910ffa3d3429c9a74f25.jpg',
'https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_5b5f4ca241678a12cff210d98755daae.jpg',
'https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_e76314c49e64152fb1eb4f25f8061d5e.jpg',
'https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_5f319b9946b6fbc5ebba8897f664efa4.jpg',
'https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_bd0a51ee5ac75272488e52ec0d82b6e8.jpg',
'https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_fbdb86adb97547599f9881480bb798b6.jpg',
'https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_6af1ba4ec0cece78812b777876c4e44b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f0e40c-d576-55bd-97cd-dd8573915c42/98f0e40c-d576-55bd-97cd-dd8573915c42_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_ebd0f29ddcc1fc94bf0e0e73f6fe5a7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f0e40c-d576-55bd-97cd-dd8573915c42/98f0e40c-d576-55bd-97cd-dd8573915c42_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63058,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_fbfff8198a46537cfd9a40a3cd59912d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f0e40c-d576-55bd-97cd-dd8573915c42/98f0e40c-d576-55bd-97cd-dd8573915c42_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58008,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_3f8ccdf3216ad951632d620f952813d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f0e40c-d576-55bd-97cd-dd8573915c42/98f0e40c-d576-55bd-97cd-dd8573915c42_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2116772,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_e5bfef6d0ffb910ffa3d3429c9a74f25.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f0e40c-d576-55bd-97cd-dd8573915c42/98f0e40c-d576-55bd-97cd-dd8573915c42_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2234699,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_5b5f4ca241678a12cff210d98755daae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f0e40c-d576-55bd-97cd-dd8573915c42/98f0e40c-d576-55bd-97cd-dd8573915c42_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_e76314c49e64152fb1eb4f25f8061d5e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f0e40c-d576-55bd-97cd-dd8573915c42/98f0e40c-d576-55bd-97cd-dd8573915c42_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2285315,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_5f319b9946b6fbc5ebba8897f664efa4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f0e40c-d576-55bd-97cd-dd8573915c42/98f0e40c-d576-55bd-97cd-dd8573915c42_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64036,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_bd0a51ee5ac75272488e52ec0d82b6e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f0e40c-d576-55bd-97cd-dd8573915c42/98f0e40c-d576-55bd-97cd-dd8573915c42_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55189,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_fbdb86adb97547599f9881480bb798b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98f0e40c-d576-55bd-97cd-dd8573915c42/98f0e40c-d576-55bd-97cd-dd8573915c42_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56684,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/7e/cf7e3af7df6ba14f7685c52f7519bb5c/pa/UA06834_6af1ba4ec0cece78812b777876c4e44b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-06-29',
'seats_number': 7,
'seller_name': None,
'title': 'Fiat Freemont 2.0 Multijet Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2014}
2026-03-30 11:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA06834%27 HTTP/1.1" 200 None
2026-03-30 11:28:49 [auto1.fr] INFO: Saving data for UA06834: {'created_time': 1774870129.697374, 'last_price_update_time': 1774870129.697384, 'auction_closing_time': 1774969875.0}
2026-03-30 11:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UA06834') HTTP/1.1" 204 0
2026-03-30 11:28:52 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.634(s), this was the 1st time calling it.
2026-03-30 11:28:52 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.342911235109015 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:28:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:29:05 [scrapy.extensions.logstats] INFO: Crawled 276 pages (at 5 pages/min), scraped 210 items (at 1 items/min)
2026-03-30 11:29:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:29:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:05 [auto1.fr] INFO: Channel: 24h | Page: 33 | totalHits: 5599 | hits on page: 40
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: MA97510
2026-03-30 11:29:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA97510%27 HTTP/1.1" 200 None
2026-03-30 11:29:05 [auto1.fr] INFO: Scrape type for MA97510: 0
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: KB64497
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: SE67845
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: PR33870
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: LD85442
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: HH88390
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: ZZ73666
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: HB02679
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: LA59879
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: RM50552
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: GC31391
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: CY61543
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: RG55649
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: WU20781
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: RT86658
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: SJ36026
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: DJ23398
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: UY92063
2026-03-30 11:29:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY92063%27 HTTP/1.1" 200 None
2026-03-30 11:29:05 [auto1.fr] INFO: Scrape type for UY92063: 0
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: TU81762
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: NA46359
2026-03-30 11:29:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NA46359%27 HTTP/1.1" 200 None
2026-03-30 11:29:05 [auto1.fr] INFO: Scrape type for NA46359: 0
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: ZT15844
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: HC15132
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: AK73885
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: ZN81951
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: SA63680
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: UX42544
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: BK74323
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: UZ07675
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: TX49254
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: UT17520
2026-03-30 11:29:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT17520%27 HTTP/1.1" 200 None
2026-03-30 11:29:05 [auto1.fr] INFO: Scrape type for UT17520: 0
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: ML75206
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: VJ46136
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: UY44160
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: HM45390
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: MC14213
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: KJ36885
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: PU11656
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: LL21207
2026-03-30 11:29:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL21207%27 HTTP/1.1" 200 None
2026-03-30 11:29:05 [auto1.fr] INFO: Scrape type for LL21207: 0
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: ET58165
2026-03-30 11:29:05 [auto1.fr] INFO: Found listing with ID: VZ93019
2026-03-30 11:29:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DS08548/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:14 [auto1.fr] INFO: Channel: 24h | Page: 34 | totalHits: 5600 | hits on page: 40
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: VZ93019
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: ZP18872
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: VL26218
2026-03-30 11:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL26218%27 HTTP/1.1" 200 None
2026-03-30 11:29:14 [auto1.fr] INFO: Scrape type for VL26218: 0
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: KM29309
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: SM81810
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: GD96207
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: NH35726
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: RZ50801
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: UN32467
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: PP18187
2026-03-30 11:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PP18187%27 HTTP/1.1" 200 None
2026-03-30 11:29:14 [auto1.fr] INFO: Scrape type for PP18187: 0
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: CF93348
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: UT91151
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: HG74686
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: JM16652
2026-03-30 11:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM16652%27 HTTP/1.1" 200 None
2026-03-30 11:29:14 [auto1.fr] INFO: Scrape type for JM16652: 0
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: UZ43867
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: TY39394
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: SC47084
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: NM34809
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: LM74101
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: BX20872
2026-03-30 11:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX20872%27 HTTP/1.1" 200 None
2026-03-30 11:29:14 [auto1.fr] INFO: Scrape type for BX20872: 0
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: DN01805
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: MD23469
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: XL24411
2026-03-30 11:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL24411%27 HTTP/1.1" 200 None
2026-03-30 11:29:14 [auto1.fr] INFO: Scrape type for XL24411: 0
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: AL18302
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: PR14744
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: KR92660
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: BA37950
2026-03-30 11:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BA37950%27 HTTP/1.1" 200 None
2026-03-30 11:29:14 [auto1.fr] INFO: Scrape type for BA37950: 0
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: YC27822
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: EZ24123
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: GB07314
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: JJ56309
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: CW74569
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: CZ19931
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: LW56484
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: BP57483
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: FF46254
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: VC85970
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: NN90836
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: PX69189
2026-03-30 11:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX69189%27 HTTP/1.1" 200 None
2026-03-30 11:29:14 [auto1.fr] INFO: Scrape type for PX69189: 0
2026-03-30 11:29:14 [auto1.fr] INFO: Found listing with ID: HC09349
2026-03-30 11:29:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DS08548> (referer: https://www.auto1.com/v1/car-details-view/DS08548/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41cc651f-6f94-50b3-bf0e-d0ec86928f55 with identifier: DS08548
2026-03-30 11:29:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41cc651f-6f94-50b3-bf0e-d0ec86928f55 with scrape type 1
2026-03-30 11:29:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 41cc651f-6f94-50b3-bf0e-d0ec86928f55
2026-03-30 11:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fd3%252Fc3d3755611ce72d18384592097233130%252Fpa%252FDS08548_055f6f833b6321c1538131b64dc0ac6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:29:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/d3/c3d3755611ce72d18384592097233130/pa/DS08548_055f6f833b6321c1538131b64dc0ac6a.jpg already downloaded
2026-03-30 11:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fd3%252Fc3d3755611ce72d18384592097233130%252Fpa%252FDS08548_2fcb5683243ffbc1ce877c4cae6bb9ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:29:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/d3/c3d3755611ce72d18384592097233130/pa/DS08548_2fcb5683243ffbc1ce877c4cae6bb9ee.jpg already downloaded
2026-03-30 11:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fd3%252Fc3d3755611ce72d18384592097233130%252Fpa%252FDS08548_86c17b520cfe1b68b7c59b353cd607eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:29:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/d3/c3d3755611ce72d18384592097233130/pa/DS08548_86c17b520cfe1b68b7c59b353cd607eb.jpg already downloaded
2026-03-30 11:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fd3%252Fc3d3755611ce72d18384592097233130%252Fpa%252FDS08548_b97bda4068e3528076a8f575d07f7591.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:29:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/d3/c3d3755611ce72d18384592097233130/pa/DS08548_b97bda4068e3528076a8f575d07f7591.jpg already downloaded
2026-03-30 11:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fd3%252Fc3d3755611ce72d18384592097233130%252Fpa%252FDS08548_c14b69dbb296778f76006262286e0e66.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:29:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/d3/c3d3755611ce72d18384592097233130/pa/DS08548_c14b69dbb296778f76006262286e0e66.jpg already downloaded
2026-03-30 11:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fd3%252Fc3d3755611ce72d18384592097233130%252Fpa%252FDS08548_8f0138c2d29e09b716c13612cf0dbb12.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:29:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/d3/c3d3755611ce72d18384592097233130/pa/DS08548_8f0138c2d29e09b716c13612cf0dbb12.jpg already downloaded
2026-03-30 11:29:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 41cc651f-6f94-50b3-bf0e-d0ec86928f55, identifier: DS08548
2026-03-30 11:29:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 41cc651f-6f94-50b3-bf0e-d0ec86928f55 with identifier: DS08548
2026-03-30 11:29:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 41cc651f-6f94-50b3-bf0e-d0ec86928f55 with identifier: DS08548
2026-03-30 11:29:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 41cc651f-6f94-50b3-bf0e-d0ec86928f55 with identifier: DS08548 to the API
2026-03-30 11:29:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:29:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:29:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DS08548>
{'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.0L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:00:55Z',
'fuel_type': 'petrol',
'id': '41cc651f-6f94-50b3-bf0e-d0ec86928f55',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS08548',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Nissan',
'model': 'Pixo',
'odometer': 224532,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgc3/d3/c3d3755611ce72d18384592097233130/pa/DS08548_055f6f833b6321c1538131b64dc0ac6a.jpg',
'https://img-pa.auto1.com/imgc3/d3/c3d3755611ce72d18384592097233130/pa/DS08548_2fcb5683243ffbc1ce877c4cae6bb9ee.jpg',
'https://img-pa.auto1.com/imgc3/d3/c3d3755611ce72d18384592097233130/pa/DS08548_86c17b520cfe1b68b7c59b353cd607eb.jpg',
'https://img-pa.auto1.com/imgc3/d3/c3d3755611ce72d18384592097233130/pa/DS08548_b97bda4068e3528076a8f575d07f7591.jpg',
'https://img-pa.auto1.com/imgc3/d3/c3d3755611ce72d18384592097233130/pa/DS08548_c14b69dbb296778f76006262286e0e66.jpg',
'https://img-pa.auto1.com/imgc3/d3/c3d3755611ce72d18384592097233130/pa/DS08548_8f0138c2d29e09b716c13612cf0dbb12.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cc651f-6f94-50b3-bf0e-d0ec86928f55/41cc651f-6f94-50b3-bf0e-d0ec86928f55_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77010,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/d3/c3d3755611ce72d18384592097233130/pa/DS08548_055f6f833b6321c1538131b64dc0ac6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cc651f-6f94-50b3-bf0e-d0ec86928f55/41cc651f-6f94-50b3-bf0e-d0ec86928f55_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/d3/c3d3755611ce72d18384592097233130/pa/DS08548_2fcb5683243ffbc1ce877c4cae6bb9ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cc651f-6f94-50b3-bf0e-d0ec86928f55/41cc651f-6f94-50b3-bf0e-d0ec86928f55_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80154,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/d3/c3d3755611ce72d18384592097233130/pa/DS08548_86c17b520cfe1b68b7c59b353cd607eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cc651f-6f94-50b3-bf0e-d0ec86928f55/41cc651f-6f94-50b3-bf0e-d0ec86928f55_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46422,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/d3/c3d3755611ce72d18384592097233130/pa/DS08548_b97bda4068e3528076a8f575d07f7591.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cc651f-6f94-50b3-bf0e-d0ec86928f55/41cc651f-6f94-50b3-bf0e-d0ec86928f55_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80810,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/d3/c3d3755611ce72d18384592097233130/pa/DS08548_c14b69dbb296778f76006262286e0e66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cc651f-6f94-50b3-bf0e-d0ec86928f55/41cc651f-6f94-50b3-bf0e-d0ec86928f55_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60271,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/d3/c3d3755611ce72d18384592097233130/pa/DS08548_8f0138c2d29e09b716c13612cf0dbb12.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Pixo 1.0 Visia',
'transmission': 'manual',
'trim': 'Visia',
'year': 2010}
2026-03-30 11:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS08548%27 HTTP/1.1" 200 None
2026-03-30 11:29:17 [auto1.fr] INFO: Saving data for DS08548: {'created_time': 1774870157.105421, 'last_price_update_time': 1774870157.105431, 'auction_closing_time': 1774969255.0}
2026-03-30 11:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DS08548') HTTP/1.1" 204 0
2026-03-30 11:29:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:20 [auto1.fr] INFO: Channel: 24h | Page: 35 | totalHits: 5600 | hits on page: 40
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: NT78881
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: KJ34319
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: GD98920
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: BL97827
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: SN72375
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: AF50767
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: TD82166
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: LL67655
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: DT73802
2026-03-30 11:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DT73802%27 HTTP/1.1" 200 None
2026-03-30 11:29:20 [auto1.fr] INFO: Scrape type for DT73802: 0
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: UR16491
2026-03-30 11:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UR16491%27 HTTP/1.1" 200 None
2026-03-30 11:29:20 [auto1.fr] INFO: Scrape type for UR16491: 0
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: UF85890
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: HF06911
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: YK42959
2026-03-30 11:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YK42959%27 HTTP/1.1" 200 None
2026-03-30 11:29:20 [auto1.fr] INFO: Scrape type for YK42959: 0
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: LB87950
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: WJ25626
2026-03-30 11:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ25626%27 HTTP/1.1" 200 None
2026-03-30 11:29:20 [auto1.fr] INFO: Scrape type for WJ25626: 0
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: WA74870
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: KC26562
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: PG06825
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: GM18501
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: JA07941
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: UD86149
2026-03-30 11:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD86149%27 HTTP/1.1" 200 None
2026-03-30 11:29:20 [auto1.fr] INFO: Scrape type for UD86149: 0
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: FU06277
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: VZ89988
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: SH02811
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: MJ04505
2026-03-30 11:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ04505%27 HTTP/1.1" 200 None
2026-03-30 11:29:20 [auto1.fr] INFO: Scrape type for MJ04505: 0
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: RJ04391
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: TC15970
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: MD03627
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: LG69185
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: AW56765
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: MX55612
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: XR55930
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: TT62412
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: GP20665
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: XF66924
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: HC72507
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: ML81854
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: ME64971
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: HD73220
2026-03-30 11:29:20 [auto1.fr] INFO: Found listing with ID: BL86276
2026-03-30 11:29:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:28 [auto1.fr] INFO: Channel: 24h | Page: 36 | totalHits: 5601 | hits on page: 40
2026-03-30 11:29:28 [auto1.fr] INFO: Found listing with ID: BL86276
2026-03-30 11:29:28 [auto1.fr] INFO: Found listing with ID: WY65543
2026-03-30 11:29:28 [auto1.fr] INFO: Found listing with ID: PP88505
2026-03-30 11:29:28 [auto1.fr] INFO: Found listing with ID: MR10155
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR10155%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.fr] INFO: Scrape type for MR10155: 0
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: JF58444
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: BP08934
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: WZ16203
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: DJ15962
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ15962%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.fr] INFO: Scrape type for DJ15962: 0
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: RY35148
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: RZ14627
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: WL88981
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: NE74351
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: KK28971
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: WJ27946
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: WU93309
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU93309%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.fr] INFO: Scrape type for WU93309: 0
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: TU06885
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU06885%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.fr] INFO: Scrape type for TU06885: 0
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: CG09144
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG09144%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.fr] INFO: Scrape type for CG09144: 0
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: VY61935
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: AH64815
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH64815%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.fr] INFO: Scrape type for AH64815: 0
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: YH52342
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: ZF71458
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZF71458%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.fr] INFO: Scrape type for ZF71458: 0
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: AS01327
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: MK61341
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: YF77818
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: YK09697
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: ZS24433
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS24433%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.fr] INFO: Scrape type for ZS24433: 0
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: RA45535
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: RG75873
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: YC64262
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: US02346
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US02346%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.fr] INFO: Scrape type for US02346: 0
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: VS91787
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: HL50910
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL50910%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.fr] INFO: Scrape type for HL50910: 0
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: BK19685
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK19685%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.fr] INFO: Scrape type for BK19685: 0
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: JE71016
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: JA39798
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: GT00876
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: AL46960
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL46960%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.fr] INFO: Scrape type for AL46960: 0
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: YR53014
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: WB17402
2026-03-30 11:29:29 [auto1.fr] INFO: Found listing with ID: VC26390
2026-03-30 11:29:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:32 [auto1.fr] INFO: Channel: 24h | Page: 37 | totalHits: 5601 | hits on page: 40
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: SZ19354
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: DY80869
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: ED61493
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: TJ13454
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: YE95249
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: DS19828
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: BD81949
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD81949%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.fr] INFO: Scrape type for BD81949: 0
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: HS13722
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: ML02900
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: RK77982
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK77982%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.fr] INFO: Scrape type for RK77982: 0
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: BE67989
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: YH76503
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH76503%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.fr] INFO: Scrape type for YH76503: 0
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: ZG89703
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: HM47617
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: TL49010
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: VF62487
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: KF52114
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: SA43115
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: UV73863
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV73863%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.fr] INFO: Scrape type for UV73863: 0
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: XL20075
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: ER09200
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: GP11392
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP11392%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.fr] INFO: Scrape type for GP11392: 0
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: KG49901
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: UD61888
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD61888%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.fr] INFO: Scrape type for UD61888: 0
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: RM00164
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: AS36390
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: KU90889
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU90889%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.fr] INFO: Scrape type for KU90889: 0
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: VG73746
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: AL35462
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: NJ66482
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: NW52748
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: EP29644
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: NS68677
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: CN39539
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: KY89343
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: AC64067
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: SR76530
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: EB39738
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB39738%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.fr] INFO: Scrape type for EB39738: 0
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: BU00959
2026-03-30 11:29:32 [auto1.fr] INFO: Found listing with ID: CY32369
2026-03-30 11:29:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:41 [auto1.fr] INFO: Channel: 24h | Page: 38 | totalHits: 5602 | hits on page: 40
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: CY32369
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: NK57774
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK57774%27 HTTP/1.1" 200 None
2026-03-30 11:29:41 [auto1.fr] INFO: Scrape type for NK57774: 0
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: SV53673
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: EV92409
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: NM58837
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM58837%27 HTTP/1.1" 200 None
2026-03-30 11:29:41 [auto1.fr] INFO: Scrape type for NM58837: 0
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: KP42994
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: KZ71097
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: RC67764
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: HR35316
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: XL60481
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL60481%27 HTTP/1.1" 200 None
2026-03-30 11:29:41 [auto1.fr] INFO: Scrape type for XL60481: 0
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: FB22935
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB22935%27 HTTP/1.1" 200 None
2026-03-30 11:29:41 [auto1.fr] INFO: Scrape type for FB22935: 0
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: ZM82858
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZM82858%27 HTTP/1.1" 200 None
2026-03-30 11:29:41 [auto1.fr] INFO: Scrape type for ZM82858: 0
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: SB76672
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: XJ36230
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ36230%27 HTTP/1.1" 200 None
2026-03-30 11:29:41 [auto1.fr] INFO: Scrape type for XJ36230: 0
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: VE53658
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: XY31555
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XY31555%27 HTTP/1.1" 200 None
2026-03-30 11:29:41 [auto1.fr] INFO: Scrape type for XY31555: 0
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: SY35677
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: VW72716
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: DZ82419
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: KX23637
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: XU30024
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: FU08159
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU08159%27 HTTP/1.1" 200 None
2026-03-30 11:29:41 [auto1.fr] INFO: Scrape type for FU08159: 0
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: VU97414
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: DT80486
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DT80486%27 HTTP/1.1" 200 None
2026-03-30 11:29:41 [auto1.fr] INFO: Scrape type for DT80486: 0
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: WM52776
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: RP20304
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP20304%27 HTTP/1.1" 200 None
2026-03-30 11:29:41 [auto1.fr] INFO: Scrape type for RP20304: 0
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: TW57421
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: YJ41205
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: RC17389
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC17389%27 HTTP/1.1" 200 None
2026-03-30 11:29:41 [auto1.fr] INFO: Scrape type for RC17389: 0
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: TR32584
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: MF63659
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: XG61570
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG61570%27 HTTP/1.1" 200 None
2026-03-30 11:29:41 [auto1.fr] INFO: Scrape type for XG61570: 0
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: WP40871
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: EZ02912
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: MM27553
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM27553%27 HTTP/1.1" 200 None
2026-03-30 11:29:41 [auto1.fr] INFO: Scrape type for MM27553: 0
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: XA54724
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: LE66923
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: SB40125
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB40125%27 HTTP/1.1" 200 None
2026-03-30 11:29:41 [auto1.fr] INFO: Scrape type for SB40125: 0
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: GP95041
2026-03-30 11:29:41 [auto1.fr] INFO: Found listing with ID: CZ77892
2026-03-30 11:29:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:45 [auto1.fr] INFO: Channel: 24h | Page: 39 | totalHits: 5602 | hits on page: 40
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: VR30765
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR30765%27 HTTP/1.1" 200 None
2026-03-30 11:29:45 [auto1.fr] INFO: Scrape type for VR30765: 0
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: TG40570
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: HD96935
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD96935%27 HTTP/1.1" 200 None
2026-03-30 11:29:45 [auto1.fr] INFO: Scrape type for HD96935: 0
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: ZX14325
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: WH09116
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WH09116%27 HTTP/1.1" 200 None
2026-03-30 11:29:45 [auto1.fr] INFO: Scrape type for WH09116: 0
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: YU99421
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: TT80789
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: TV87876
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: PV47971
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV47971%27 HTTP/1.1" 200 None
2026-03-30 11:29:45 [auto1.fr] INFO: Scrape type for PV47971: 0
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: XG32357
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: BB56606
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BB56606%27 HTTP/1.1" 200 None
2026-03-30 11:29:45 [auto1.fr] INFO: Scrape type for BB56606: 0
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: NH32818
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: LZ87734
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: YG68937
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: FX00689
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: CZ00697
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: BC53965
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: NC54891
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: LP57599
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: CB31058
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: UN80440
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: YV99261
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: EZ77748
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ77748%27 HTTP/1.1" 200 None
2026-03-30 11:29:45 [auto1.fr] INFO: Scrape type for EZ77748: 0
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: RP24230
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: UX03179
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX03179%27 HTTP/1.1" 200 None
2026-03-30 11:29:45 [auto1.fr] INFO: Scrape type for UX03179: 0
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: AN74735
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: DD23004
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: HW49915
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: CJ57312
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: TV19720
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: FS46454
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: CX30870
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: GV45049
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: ZP90571
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP90571%27 HTTP/1.1" 200 None
2026-03-30 11:29:45 [auto1.fr] INFO: Scrape type for ZP90571: 0
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: WM44955
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: PC41245
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: HB05529
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: YF00056
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: RY17691
2026-03-30 11:29:45 [auto1.fr] INFO: Found listing with ID: GJ24206
2026-03-30 11:29:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:05 [scrapy.extensions.logstats] INFO: Crawled 285 pages (at 9 pages/min), scraped 211 items (at 1 items/min)
2026-03-30 11:30:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:31:05 [scrapy.extensions.logstats] INFO: Crawled 285 pages (at 0 pages/min), scraped 211 items (at 0 items/min)
2026-03-30 11:31:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:31:54 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.297(s), this was the 1st time calling it.
2026-03-30 11:31:54 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.211065398196143 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:32:05 [scrapy.extensions.logstats] INFO: Crawled 285 pages (at 0 pages/min), scraped 211 items (at 0 items/min)
2026-03-30 11:32:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:33:05 [scrapy.extensions.logstats] INFO: Crawled 285 pages (at 0 pages/min), scraped 211 items (at 0 items/min)
2026-03-30 11:33:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:34:05 [scrapy.extensions.logstats] INFO: Crawled 285 pages (at 0 pages/min), scraped 211 items (at 0 items/min)
2026-03-30 11:34:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:34:11 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.517(s), this was the 2nd time calling it.
2026-03-30 11:34:11 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.392903900025026 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:34:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:20 [auto1.fr] INFO: Channel: 24h | Page: 40 | totalHits: 5617 | hits on page: 40
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: AN74735
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: DD23004
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: HW49915
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: CJ57312
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: TV19720
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: FS46454
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: CX30870
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: GV45049
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: ZP90571
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP90571%27 HTTP/1.1" 200 None
2026-03-30 11:34:20 [auto1.fr] INFO: Scrape type for ZP90571: 0
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: WM44955
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: PC41245
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: HB05529
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: YF00056
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: RY17691
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: GJ24206
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: US33967
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: LM27279
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: FM08864
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM08864%27 HTTP/1.1" 200 None
2026-03-30 11:34:20 [auto1.fr] INFO: Scrape type for FM08864: 0
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: RV55233
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: FE50003
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: US09137
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: WB86369
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB86369%27 HTTP/1.1" 200 None
2026-03-30 11:34:20 [auto1.fr] INFO: Scrape type for WB86369: 0
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: KB61769
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: AA82428
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: FC34806
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: HD23941
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: UG12644
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: DF97740
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: PS35063
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: BB27809
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: SU00375
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU00375%27 HTTP/1.1" 200 None
2026-03-30 11:34:20 [auto1.fr] INFO: Scrape type for SU00375: 0
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: KK91904
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: GV16284
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: CH91166
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: FH42634
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH42634%27 HTTP/1.1" 200 None
2026-03-30 11:34:20 [auto1.fr] INFO: Scrape type for FH42634: 0
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: GV13261
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: GU78027
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: AD19719
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: UZ91010
2026-03-30 11:34:20 [auto1.fr] INFO: Found listing with ID: SL05897
2026-03-30 11:34:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:22 [auto1.fr] INFO: Channel: 24h | Page: 41 | totalHits: 5617 | hits on page: 40
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: UG53294
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: RY43712
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: EU28848
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: LG77466
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG77466%27 HTTP/1.1" 200 None
2026-03-30 11:34:22 [auto1.fr] INFO: Scrape type for LG77466: 0
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: CR73549
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: DU99453
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: MS42511
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: LE66377
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: XS52367
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: DV55941
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV55941%27 HTTP/1.1" 200 None
2026-03-30 11:34:22 [auto1.fr] INFO: Scrape type for DV55941: 0
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: JD19463
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD19463%27 HTTP/1.1" 200 None
2026-03-30 11:34:22 [auto1.fr] INFO: Scrape type for JD19463: 0
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: WB51756
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: MH16363
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: KK35444
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: JC79144
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: JA97388
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: AH02524
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: GY97445
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: NR32441
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: PA02750
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: JB86421
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: HD01338
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD01338%27 HTTP/1.1" 200 None
2026-03-30 11:34:22 [auto1.fr] INFO: Scrape type for HD01338: 0
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: MH40412
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH40412%27 HTTP/1.1" 200 None
2026-03-30 11:34:22 [auto1.fr] INFO: Scrape type for MH40412: 0
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: UF91240
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: HE88898
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: FG87897
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: WN28204
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN28204%27 HTTP/1.1" 200 None
2026-03-30 11:34:22 [auto1.fr] INFO: Scrape type for WN28204: 0
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: JM92478
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: SC90011
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC90011%27 HTTP/1.1" 200 None
2026-03-30 11:34:22 [auto1.fr] INFO: Scrape type for SC90011: 0
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: DJ04240
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: JR92262
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: CZ59485
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ59485%27 HTTP/1.1" 200 None
2026-03-30 11:34:22 [auto1.fr] INFO: Scrape type for CZ59485: 0
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: LJ50590
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: EZ42976
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: AX20284
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: DT57563
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: LA97865
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA97865%27 HTTP/1.1" 200 None
2026-03-30 11:34:22 [auto1.fr] INFO: Scrape type for LA97865: 0
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: WW85348
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: JA31656
2026-03-30 11:34:22 [auto1.fr] INFO: Found listing with ID: VN06433
2026-03-30 11:34:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:24 [auto1.fr] INFO: Channel: 24h | Page: 42 | totalHits: 5617 | hits on page: 40
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: MR60637
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: UK47887
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: AU99962
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AU99962%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.fr] INFO: Scrape type for AU99962: 0
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: FF11603
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: PU35447
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: SB24854
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: GN79133
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: CR56365
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: HV80802
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: RW72165
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: TS50900
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: WT80779
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: NY88929
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: BP08503
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: TU98697
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: DP24552
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: DC92769
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: LB88529
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: RU88494
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: BR96197
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: WZ91976
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: YW24880
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YW24880%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.fr] INFO: Scrape type for YW24880: 0
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: RD81906
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: VD85530
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: ZZ63110
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: JD88175
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD88175%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.fr] INFO: Scrape type for JD88175: 0
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: KN83652
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: XM88394
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: UN69566
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: YE52567
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: AV43022
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV43022%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.fr] INFO: Scrape type for AV43022: 0
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: YS40349
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS40349%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.fr] INFO: Scrape type for YS40349: 0
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: UN71738
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: KY94176
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: EW17519
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW17519%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.fr] INFO: Scrape type for EW17519: 0
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: KM48677
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: BJ00479
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: TK13160
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: TA86681
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA86681%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.fr] INFO: Scrape type for TA86681: 0
2026-03-30 11:34:24 [auto1.fr] INFO: Found listing with ID: ZS70845
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS70845%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.fr] INFO: Scrape type for ZS70845: 0
2026-03-30 11:34:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:28 [auto1.fr] INFO: Channel: 24h | Page: 43 | totalHits: 5618 | hits on page: 40
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: ZS70845
2026-03-30 11:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS70845%27 HTTP/1.1" 200 None
2026-03-30 11:34:28 [auto1.fr] INFO: Scrape type for ZS70845: 0
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: DR03855
2026-03-30 11:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR03855%27 HTTP/1.1" 200 None
2026-03-30 11:34:28 [auto1.fr] INFO: Scrape type for DR03855: 0
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: UU78194
2026-03-30 11:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UU78194%27 HTTP/1.1" 200 None
2026-03-30 11:34:28 [auto1.fr] INFO: Scrape type for UU78194: 0
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: XC12910
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: GK12923
2026-03-30 11:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GK12923%27 HTTP/1.1" 200 None
2026-03-30 11:34:28 [auto1.fr] INFO: Scrape type for GK12923: 0
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: ED30549
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: FP56567
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: MA97525
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: JP68458
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: UU97662
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: TD37120
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: CH51524
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: KZ82903
2026-03-30 11:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KZ82903%27 HTTP/1.1" 200 None
2026-03-30 11:34:28 [auto1.fr] INFO: Scrape type for KZ82903: 0
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: DA95179
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: PS03544
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: SM18119
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: NV40153
2026-03-30 11:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV40153%27 HTTP/1.1" 200 None
2026-03-30 11:34:28 [auto1.fr] INFO: Scrape type for NV40153: 0
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: HC11579
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: VU20928
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: TU95622
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: MP79242
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: UN27174
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: ST86387
2026-03-30 11:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST86387%27 HTTP/1.1" 200 None
2026-03-30 11:34:28 [auto1.fr] INFO: Scrape type for ST86387: 0
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: GB89702
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: BR71892
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: HC26827
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: BW59043
2026-03-30 11:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BW59043%27 HTTP/1.1" 200 None
2026-03-30 11:34:28 [auto1.fr] INFO: Scrape type for BW59043: 0
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: PY54442
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: PZ23604
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: TR06139
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: GT76916
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: ZB50879
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: VX02215
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: HS16124
2026-03-30 11:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS16124%27 HTTP/1.1" 200 None
2026-03-30 11:34:28 [auto1.fr] INFO: Scrape type for HS16124: 0
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: KY83359
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: JE64469
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: GY04533
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: XV08486
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: DB05758
2026-03-30 11:34:28 [auto1.fr] INFO: Found listing with ID: JK19840
2026-03-30 11:34:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:29 [auto1.fr] INFO: Channel: 24h | Page: 44 | totalHits: 5618 | hits on page: 40
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: CS05436
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: AV43002
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: VK86553
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: LB61195
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: CV53025
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV53025%27 HTTP/1.1" 200 None
2026-03-30 11:34:29 [auto1.fr] INFO: Scrape type for CV53025: 0
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: HZ13554
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ13554%27 HTTP/1.1" 200 None
2026-03-30 11:34:29 [auto1.fr] INFO: Scrape type for HZ13554: 0
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: VH59427
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: FW77830
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: BV15124
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV15124%27 HTTP/1.1" 200 None
2026-03-30 11:34:29 [auto1.fr] INFO: Scrape type for BV15124: 0
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: MY50344
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: JE59185
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: RF61096
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF61096%27 HTTP/1.1" 200 None
2026-03-30 11:34:29 [auto1.fr] INFO: Scrape type for RF61096: 0
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: ES00688
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: KX77724
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: RK64149
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: NC81126
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: CM99932
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: GS85289
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: TY67810
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY67810%27 HTTP/1.1" 200 None
2026-03-30 11:34:29 [auto1.fr] INFO: Scrape type for TY67810: 0
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: YF49092
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: WA91522
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: UY70562
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: BL07559
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: RT20900
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT20900%27 HTTP/1.1" 200 None
2026-03-30 11:34:29 [auto1.fr] INFO: Scrape type for RT20900: 0
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: WF50159
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: YB23666
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB23666%27 HTTP/1.1" 200 None
2026-03-30 11:34:29 [auto1.fr] INFO: Scrape type for YB23666: 0
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: YL62240
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: ET81896
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET81896%27 HTTP/1.1" 200 None
2026-03-30 11:34:29 [auto1.fr] INFO: Scrape type for ET81896: 0
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: TZ96762
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: FK74107
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: MT15159
2026-03-30 11:34:29 [auto1.fr] INFO: Found listing with ID: PU53670
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU53670%27 HTTP/1.1" 200 None
2026-03-30 11:34:29 [auto1.fr] INFO: Scrape type for PU53670: 0
2026-03-30 11:34:30 [auto1.fr] INFO: Found listing with ID: PH00678
2026-03-30 11:34:30 [auto1.fr] INFO: Found listing with ID: XR63373
2026-03-30 11:34:30 [auto1.fr] INFO: Found listing with ID: HL48033
2026-03-30 11:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL48033%27 HTTP/1.1" 200 None
2026-03-30 11:34:30 [auto1.fr] INFO: Scrape type for HL48033: 0
2026-03-30 11:34:30 [auto1.fr] INFO: Found listing with ID: LN56424
2026-03-30 11:34:30 [auto1.fr] INFO: Found listing with ID: CR76984
2026-03-30 11:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR76984%27 HTTP/1.1" 200 None
2026-03-30 11:34:30 [auto1.fr] INFO: Scrape type for CR76984: 0
2026-03-30 11:34:30 [auto1.fr] INFO: Found listing with ID: EV44924
2026-03-30 11:34:30 [auto1.fr] INFO: Found listing with ID: UF18286
2026-03-30 11:34:30 [auto1.fr] INFO: Found listing with ID: AS97148
2026-03-30 11:34:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:31 [auto1.fr] INFO: Channel: 24h | Page: 45 | totalHits: 5618 | hits on page: 40
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: TA06256
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: RH74389
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: BU68611
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: GW86629
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW86629%27 HTTP/1.1" 200 None
2026-03-30 11:34:31 [auto1.fr] INFO: Scrape type for GW86629: 0
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: LY60443
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: YV24862
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: EG36115
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: UG76760
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG76760%27 HTTP/1.1" 200 None
2026-03-30 11:34:31 [auto1.fr] INFO: Scrape type for UG76760: 0
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: ME85420
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME85420%27 HTTP/1.1" 200 None
2026-03-30 11:34:31 [auto1.fr] INFO: Scrape type for ME85420: 0
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: RF02731
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: RM90440
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM90440%27 HTTP/1.1" 200 None
2026-03-30 11:34:31 [auto1.fr] INFO: Scrape type for RM90440: 0
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: HZ04816
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: VZ14936
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: FJ40576
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: VH19414
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: HH64622
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH64622%27 HTTP/1.1" 200 None
2026-03-30 11:34:31 [auto1.fr] INFO: Scrape type for HH64622: 0
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: ZG91850
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG91850%27 HTTP/1.1" 200 None
2026-03-30 11:34:31 [auto1.fr] INFO: Scrape type for ZG91850: 0
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: FD88175
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD88175%27 HTTP/1.1" 200 None
2026-03-30 11:34:31 [auto1.fr] INFO: Scrape type for FD88175: 0
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: DU86816
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU86816%27 HTTP/1.1" 200 None
2026-03-30 11:34:31 [auto1.fr] INFO: Scrape type for DU86816: 0
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: PT40364
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PT40364%27 HTTP/1.1" 200 None
2026-03-30 11:34:31 [auto1.fr] INFO: Scrape type for PT40364: 0
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: GF79733
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: SV83772
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV83772%27 HTTP/1.1" 200 None
2026-03-30 11:34:31 [auto1.fr] INFO: Scrape type for SV83772: 0
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: RN40688
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: PX19545
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX19545%27 HTTP/1.1" 200 None
2026-03-30 11:34:31 [auto1.fr] INFO: Scrape type for PX19545: 0
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: ZA46036
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: DH49026
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: DE34484
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: XF91817
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XF91817%27 HTTP/1.1" 200 None
2026-03-30 11:34:31 [auto1.fr] INFO: Scrape type for XF91817: 0
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: AL30911
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL30911%27 HTTP/1.1" 200 None
2026-03-30 11:34:31 [auto1.fr] INFO: Scrape type for AL30911: 0
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: RU14335
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU14335%27 HTTP/1.1" 200 None
2026-03-30 11:34:31 [auto1.fr] INFO: Scrape type for RU14335: 0
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: TF47618
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: KK47613
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK47613%27 HTTP/1.1" 200 None
2026-03-30 11:34:31 [auto1.fr] INFO: Scrape type for KK47613: 0
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: XY05903
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: PK63725
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK63725%27 HTTP/1.1" 200 None
2026-03-30 11:34:31 [auto1.fr] INFO: Scrape type for PK63725: 0
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: GD34494
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD34494%27 HTTP/1.1" 200 None
2026-03-30 11:34:31 [auto1.fr] INFO: Scrape type for GD34494: 0
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: RM88009
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: EG05760
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG05760%27 HTTP/1.1" 200 None
2026-03-30 11:34:31 [auto1.fr] INFO: Scrape type for EG05760: 0
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: CR88362
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: EU10176
2026-03-30 11:34:31 [auto1.fr] INFO: Found listing with ID: PC21367
2026-03-30 11:34:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:05 [scrapy.extensions.logstats] INFO: Crawled 291 pages (at 6 pages/min), scraped 211 items (at 0 items/min)
2026-03-30 11:35:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:35:40 [auto1.fr] INFO: Channel: 24h | Page: 46 | totalHits: 5622 | hits on page: 40
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: EG05760
2026-03-30 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG05760%27 HTTP/1.1" 200 None
2026-03-30 11:35:40 [auto1.fr] INFO: Scrape type for EG05760: 0
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: CR88362
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: EU10176
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: PC21367
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: TE59024
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: XK29074
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: ZH07724
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: KY56132
2026-03-30 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY56132%27 HTTP/1.1" 200 None
2026-03-30 11:35:40 [auto1.fr] INFO: Scrape type for KY56132: 0
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: ET80426
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: HM98474
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: CP27331
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: YN59127
2026-03-30 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YN59127%27 HTTP/1.1" 200 None
2026-03-30 11:35:40 [auto1.fr] INFO: Scrape type for YN59127: 0
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: GS14408
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: BT96951
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: CM59464
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: JB73715
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: UA00783
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: XW59366
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: FC11298
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: WR28660
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: DT87361
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: RL46658
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: AY53141
2026-03-30 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY53141%27 HTTP/1.1" 200 None
2026-03-30 11:35:40 [auto1.fr] INFO: Scrape type for AY53141: 0
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: JC15931
2026-03-30 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC15931%27 HTTP/1.1" 200 None
2026-03-30 11:35:40 [auto1.fr] INFO: Scrape type for JC15931: 0
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: GL13971
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: YZ30566
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: KC80653
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: WE42634
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: DL43770
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: SG63516
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: KU76241
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: TF28062
2026-03-30 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF28062%27 HTTP/1.1" 200 None
2026-03-30 11:35:40 [auto1.fr] INFO: Scrape type for TF28062: 0
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: PB24678
2026-03-30 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB24678%27 HTTP/1.1" 200 None
2026-03-30 11:35:40 [auto1.fr] INFO: Scrape type for PB24678: 0
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: PH76438
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: TC93475
2026-03-30 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC93475%27 HTTP/1.1" 200 None
2026-03-30 11:35:40 [auto1.fr] INFO: Scrape type for TC93475: 0
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: WX51378
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: RC92167
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: VH05370
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: GP91513
2026-03-30 11:35:40 [auto1.fr] INFO: Found listing with ID: RV34760
2026-03-30 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV34760%27 HTTP/1.1" 200 None
2026-03-30 11:35:40 [auto1.fr] INFO: Scrape type for RV34760: 0
2026-03-30 11:35:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:05 [scrapy.extensions.logstats] INFO: Crawled 292 pages (at 1 pages/min), scraped 211 items (at 0 items/min)
2026-03-30 11:36:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:37:05 [scrapy.extensions.logstats] INFO: Crawled 292 pages (at 0 pages/min), scraped 211 items (at 0 items/min)
2026-03-30 11:37:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:37:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.903(s), this was the 1st time calling it.
2026-03-30 11:37:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.339246760072401 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:37:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:38:05 [scrapy.extensions.logstats] INFO: Crawled 292 pages (at 0 pages/min), scraped 211 items (at 0 items/min)
2026-03-30 11:38:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:06 [auto1.fr] INFO: Channel: 24h | Page: 47 | totalHits: 5629 | hits on page: 40
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: PH76438
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: TC93475
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC93475%27 HTTP/1.1" 200 None
2026-03-30 11:38:06 [auto1.fr] INFO: Scrape type for TC93475: 0
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: WX51378
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: RC92167
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: VH05370
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: GP91513
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: RV34760
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV34760%27 HTTP/1.1" 200 None
2026-03-30 11:38:06 [auto1.fr] INFO: Scrape type for RV34760: 0
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: ZE94159
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: BN42642
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: WE94364
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: FN88913
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: VD29349
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD29349%27 HTTP/1.1" 200 None
2026-03-30 11:38:06 [auto1.fr] INFO: Scrape type for VD29349: 0
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: PR85507
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: YG85438
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG85438%27 HTTP/1.1" 200 None
2026-03-30 11:38:06 [auto1.fr] INFO: Scrape type for YG85438: 0
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: VV07532
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: HZ23469
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ23469%27 HTTP/1.1" 200 None
2026-03-30 11:38:06 [auto1.fr] INFO: Scrape type for HZ23469: 0
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: KL95913
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL95913%27 HTTP/1.1" 200 None
2026-03-30 11:38:06 [auto1.fr] INFO: Scrape type for KL95913: 0
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: TP14715
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP14715%27 HTTP/1.1" 200 None
2026-03-30 11:38:06 [auto1.fr] INFO: Scrape type for TP14715: 0
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: VW75934
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: TF52157
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: FK90756
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: YG01990
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: JY63896
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: XG78208
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: JF83013
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: TD76291
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: TC88438
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: KV22116
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV22116%27 HTTP/1.1" 200 None
2026-03-30 11:38:06 [auto1.fr] INFO: Scrape type for KV22116: 0
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: JJ20358
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: CR66556
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: ML08473
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: FS26892
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS26892%27 HTTP/1.1" 200 None
2026-03-30 11:38:06 [auto1.fr] INFO: Scrape type for FS26892: 0
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: YM47436
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YM47436%27 HTTP/1.1" 200 None
2026-03-30 11:38:06 [auto1.fr] INFO: Scrape type for YM47436: 0
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: PP45354
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: SP18909
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SP18909%27 HTTP/1.1" 200 None
2026-03-30 11:38:06 [auto1.fr] INFO: Scrape type for SP18909: 0
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: CE39822
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: PJ71258
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: HT03619
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: SD39167
2026-03-30 11:38:06 [auto1.fr] INFO: Found listing with ID: ZX16106
2026-03-30 11:38:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:26 [auto1.fr] INFO: Channel: 24h | Page: 48 | totalHits: 5630 | hits on page: 40
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: ZX16106
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: XC14810
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC14810%27 HTTP/1.1" 200 None
2026-03-30 11:38:26 [auto1.fr] INFO: Scrape type for XC14810: 0
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: NM30774
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: ZJ10525
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: GR50483
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR50483%27 HTTP/1.1" 200 None
2026-03-30 11:38:26 [auto1.fr] INFO: Scrape type for GR50483: 0
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: SP16079
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: HG70270
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: EP58650
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: JD75857
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: WN71297
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: UL00311
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: WT16167
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: WG34864
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: BS59441
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: EP02356
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: WY58185
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: CF82248
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: FF99969
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: SB50170
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: AX33838
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX33838%27 HTTP/1.1" 200 None
2026-03-30 11:38:26 [auto1.fr] INFO: Scrape type for AX33838: 0
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: SF18063
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: HS10624
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: TN34978
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TN34978%27 HTTP/1.1" 200 None
2026-03-30 11:38:26 [auto1.fr] INFO: Scrape type for TN34978: 0
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: PZ64632
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: VN15775
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: UF74550
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: JA06756
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: YU48972
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: NW62484
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW62484%27 HTTP/1.1" 200 None
2026-03-30 11:38:26 [auto1.fr] INFO: Scrape type for NW62484: 0
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: XG04950
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: HW47298
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: MX67130
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: ZR29296
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: ZJ13303
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ13303%27 HTTP/1.1" 200 None
2026-03-30 11:38:26 [auto1.fr] INFO: Scrape type for ZJ13303: 0
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: DU45588
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: VR61132
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: EN42753
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: UW84177
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: SA45577
2026-03-30 11:38:26 [auto1.fr] INFO: Found listing with ID: JL56998
2026-03-30 11:38:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:30 [auto1.fr] INFO: Channel: 24h | Page: 49 | totalHits: 5629 | hits on page: 40
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: EU97326
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU97326%27 HTTP/1.1" 200 None
2026-03-30 11:38:30 [auto1.fr] INFO: Scrape type for EU97326: 0
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: BZ34832
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: SC17233
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC17233%27 HTTP/1.1" 200 None
2026-03-30 11:38:30 [auto1.fr] INFO: Scrape type for SC17233: 0
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: VZ69703
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VZ69703%27 HTTP/1.1" 200 None
2026-03-30 11:38:30 [auto1.fr] INFO: Scrape type for VZ69703: 0
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: FD77959
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: HW16085
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: LN69562
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: VW89313
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: AU78489
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: WC88587
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC88587%27 HTTP/1.1" 200 None
2026-03-30 11:38:30 [auto1.fr] INFO: Scrape type for WC88587: 0
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: FE99224
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: FJ52968
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ52968%27 HTTP/1.1" 200 None
2026-03-30 11:38:30 [auto1.fr] INFO: Scrape type for FJ52968: 0
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: SY37081
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: ET87110
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: XS30683
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS30683%27 HTTP/1.1" 200 None
2026-03-30 11:38:30 [auto1.fr] INFO: Scrape type for XS30683: 0
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: JN85436
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: BE57135
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: MJ15243
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: FG74412
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: WC30814
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC30814%27 HTTP/1.1" 200 None
2026-03-30 11:38:30 [auto1.fr] INFO: Scrape type for WC30814: 0
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: AU34374
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: FC16056
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: BN20947
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: BK46201
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK46201%27 HTTP/1.1" 200 None
2026-03-30 11:38:30 [auto1.fr] INFO: Scrape type for BK46201: 0
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: BY34409
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: DA74312
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: AD02519
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: HA44831
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: NJ98354
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ98354%27 HTTP/1.1" 200 None
2026-03-30 11:38:30 [auto1.fr] INFO: Scrape type for NJ98354: 0
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: JS58484
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: RD34748
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: AE76262
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: AD27971
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: FV51359
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: NP89153
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP89153%27 HTTP/1.1" 200 None
2026-03-30 11:38:30 [auto1.fr] INFO: Scrape type for NP89153: 0
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: KJ57262
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: AN53736
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN53736%27 HTTP/1.1" 200 None
2026-03-30 11:38:30 [auto1.fr] INFO: Scrape type for AN53736: 0
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: HS78914
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: EP11372
2026-03-30 11:38:30 [auto1.fr] INFO: Found listing with ID: YP70833
2026-03-30 11:38:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:38 [auto1.fr] INFO: Channel: 24h | Page: 50 | totalHits: 5630 | hits on page: 40
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: YP70833
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: EN38687
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: FC77487
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: GR64183
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR64183%27 HTTP/1.1" 200 None
2026-03-30 11:38:38 [auto1.fr] INFO: Scrape type for GR64183: 0
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: WM94838
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: VY98975
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY98975%27 HTTP/1.1" 200 None
2026-03-30 11:38:38 [auto1.fr] INFO: Scrape type for VY98975: 0
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: NB86728
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: RA43696
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: DA01583
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: RG25763
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: WE75326
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: AJ56245
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: GA49248
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA49248%27 HTTP/1.1" 200 None
2026-03-30 11:38:38 [auto1.fr] INFO: Scrape type for GA49248: 0
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: BF38524
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: XY93401
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: GZ53254
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: XP87146
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP87146%27 HTTP/1.1" 200 None
2026-03-30 11:38:38 [auto1.fr] INFO: Scrape type for XP87146: 0
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: KX22014
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: SU46936
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU46936%27 HTTP/1.1" 200 None
2026-03-30 11:38:38 [auto1.fr] INFO: Scrape type for SU46936: 0
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: GL96546
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: FL57229
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL57229%27 HTTP/1.1" 200 None
2026-03-30 11:38:38 [auto1.fr] INFO: Scrape type for FL57229: 0
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: EY43562
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: PJ58466
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: NT71606
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: NF56121
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: JN84809
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: BJ21713
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: FA19714
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: WT28767
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: EE38454
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: NW11440
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: TF09814
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: BV42943
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV42943%27 HTTP/1.1" 200 None
2026-03-30 11:38:38 [auto1.fr] INFO: Scrape type for BV42943: 0
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: DS86790
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS86790%27 HTTP/1.1" 200 None
2026-03-30 11:38:38 [auto1.fr] INFO: Scrape type for DS86790: 0
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: WW09364
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW09364%27 HTTP/1.1" 200 None
2026-03-30 11:38:38 [auto1.fr] INFO: Scrape type for WW09364: 0
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: GJ50416
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: JL83029
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: RV34061
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: KM43953
2026-03-30 11:38:38 [auto1.fr] INFO: Found listing with ID: NT40174
2026-03-30 11:38:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:40 [auto1.fr] INFO: Channel: 24h | Page: 51 | totalHits: 5630 | hits on page: 40
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: HT28444
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: HU00304
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HU00304%27 HTTP/1.1" 200 None
2026-03-30 11:38:40 [auto1.fr] INFO: Scrape type for HU00304: 0
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: LP53379
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP53379%27 HTTP/1.1" 200 None
2026-03-30 11:38:40 [auto1.fr] INFO: Scrape type for LP53379: 0
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: KC91262
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC91262%27 HTTP/1.1" 200 None
2026-03-30 11:38:40 [auto1.fr] INFO: Scrape type for KC91262: 0
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: UZ76323
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: DC76533
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: JG57879
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG57879%27 HTTP/1.1" 200 None
2026-03-30 11:38:40 [auto1.fr] INFO: Scrape type for JG57879: 0
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: WT28512
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: NY42811
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: MJ11877
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: RE46852
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: FH64554
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: UG99698
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG99698%27 HTTP/1.1" 200 None
2026-03-30 11:38:40 [auto1.fr] INFO: Scrape type for UG99698: 0
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: MB40606
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: ZN14071
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: VK90720
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK90720%27 HTTP/1.1" 200 None
2026-03-30 11:38:40 [auto1.fr] INFO: Scrape type for VK90720: 0
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: SG50476
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: BA32489
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: UG12911
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: FZ67075
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: LM93493
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: PY86301
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: BD78122
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD78122%27 HTTP/1.1" 200 None
2026-03-30 11:38:40 [auto1.fr] INFO: Scrape type for BD78122: 0
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: ET77634
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: WN39740
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: EM63803
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: CP19096
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: SB35500
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB35500%27 HTTP/1.1" 200 None
2026-03-30 11:38:40 [auto1.fr] INFO: Scrape type for SB35500: 0
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: DW60066
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: VE09288
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: TR00215
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: YS98030
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: JK99343
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: GW36341
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: BB19718
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: BP75833
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: LN33446
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: RN44054
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: GL34053
2026-03-30 11:38:40 [auto1.fr] INFO: Found listing with ID: VG58676
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG58676%27 HTTP/1.1" 200 None
2026-03-30 11:38:40 [auto1.fr] INFO: Scrape type for VG58676: 0
2026-03-30 11:38:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:51 [auto1.fr] INFO: Channel: 24h | Page: 52 | totalHits: 5629 | hits on page: 40
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: PU86192
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: XL81753
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL81753%27 HTTP/1.1" 200 None
2026-03-30 11:38:51 [auto1.fr] INFO: Scrape type for XL81753: 0
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: DR88141
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: XB93727
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: MR10042
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: SS28522
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: GA53599
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: TE18258
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: YV47124
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: RL32198
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: AX80652
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: ZJ77199
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: LL81024
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL81024%27 HTTP/1.1" 200 None
2026-03-30 11:38:51 [auto1.fr] INFO: Scrape type for LL81024: 0
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: DZ77281
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: NG02630
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: HR11664
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: LM45314
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM45314%27 HTTP/1.1" 200 None
2026-03-30 11:38:51 [auto1.fr] INFO: Scrape type for LM45314: 0
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: TS08429
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TS08429%27 HTTP/1.1" 200 None
2026-03-30 11:38:51 [auto1.fr] INFO: Scrape type for TS08429: 0
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: BC69120
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: XE09151
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: SP01083
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: LT87826
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: DT69522
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: XS77464
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: ZS29376
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: FK45009
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK45009%27 HTTP/1.1" 200 None
2026-03-30 11:38:51 [auto1.fr] INFO: Scrape type for FK45009: 0
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: DD98882
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: PJ67471
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ67471%27 HTTP/1.1" 200 None
2026-03-30 11:38:51 [auto1.fr] INFO: Scrape type for PJ67471: 0
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: PW23441
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: VU76630
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU76630%27 HTTP/1.1" 200 None
2026-03-30 11:38:51 [auto1.fr] INFO: Scrape type for VU76630: 0
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: GJ52269
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ52269%27 HTTP/1.1" 200 None
2026-03-30 11:38:51 [auto1.fr] INFO: Scrape type for GJ52269: 0
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: YL35508
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: MN16566
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: EU62786
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: SF69794
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: TR33282
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR33282%27 HTTP/1.1" 200 None
2026-03-30 11:38:51 [auto1.fr] INFO: Scrape type for TR33282: 0
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: PN91835
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: WS10541
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: CS38790
2026-03-30 11:38:51 [auto1.fr] INFO: Found listing with ID: GB26674
2026-03-30 11:38:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:54 [auto1.fr] INFO: Channel: 24h | Page: 53 | totalHits: 5629 | hits on page: 40
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: UG23105
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: ZA30500
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: SN74584
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: FB96691
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB96691%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.fr] INFO: Scrape type for FB96691: 0
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: ZP58088
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: AL20646
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: XV78240
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV78240%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.fr] INFO: Scrape type for XV78240: 0
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: FC20629
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: CA10515
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: VN08853
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: VE24718
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE24718%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.fr] INFO: Scrape type for VE24718: 0
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: DH38418
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH38418%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.fr] INFO: Scrape type for DH38418: 0
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: TP34796
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: CF12367
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: LY09087
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY09087%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.fr] INFO: Scrape type for LY09087: 0
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: ZR86922
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: RY57669
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: UJ10751
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: BL61281
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL61281%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.fr] INFO: Scrape type for BL61281: 0
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: JM50372
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: HY48791
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HY48791%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.fr] INFO: Scrape type for HY48791: 0
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: JD17568
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: KC40522
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: GX94493
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: BC44754
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: VX53860
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: UP40309
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: XJ68451
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: RP72244
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: BH82071
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: RB10191
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: RS96819
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RS96819%27 HTTP/1.1" 200 None
2026-03-30 11:38:54 [auto1.fr] INFO: Scrape type for RS96819: 0
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: FN73019
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: GU96454
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: ZZ44296
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: XB50812
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: RH01307
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: PB10220
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: MC25764
2026-03-30 11:38:54 [auto1.fr] INFO: Found listing with ID: ZB38417
2026-03-30 11:38:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:39:05 [scrapy.extensions.logstats] INFO: Crawled 299 pages (at 7 pages/min), scraped 211 items (at 0 items/min)
2026-03-30 11:39:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:40:05 [scrapy.extensions.logstats] INFO: Crawled 299 pages (at 0 pages/min), scraped 211 items (at 0 items/min)
2026-03-30 11:40:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:41:05 [scrapy.extensions.logstats] INFO: Crawled 299 pages (at 0 pages/min), scraped 211 items (at 0 items/min)
2026-03-30 11:41:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:41:05 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.172(s), this was the 1st time calling it.
2026-03-30 11:41:05 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.855611716310998 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:41:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:41:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:22 [auto1.fr] INFO: Channel: 24h | Page: 54 | totalHits: 5635 | hits on page: 40
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: ZZ44296
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: XB50812
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: RH01307
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: PB10220
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: MC25764
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: ZB38417
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: NU36463
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: CP98905
2026-03-30 11:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP98905%27 HTTP/1.1" 200 None
2026-03-30 11:41:22 [auto1.fr] INFO: Scrape type for CP98905: 0
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: SC64672
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: GS64031
2026-03-30 11:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS64031%27 HTTP/1.1" 200 None
2026-03-30 11:41:22 [auto1.fr] INFO: Scrape type for GS64031: 0
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: WR04553
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: SD31410
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: VG33194
2026-03-30 11:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG33194%27 HTTP/1.1" 200 None
2026-03-30 11:41:22 [auto1.fr] INFO: Scrape type for VG33194: 0
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: PX20889
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: JJ33081
2026-03-30 11:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ33081%27 HTTP/1.1" 200 None
2026-03-30 11:41:22 [auto1.fr] INFO: Scrape type for JJ33081: 0
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: EC92404
2026-03-30 11:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC92404%27 HTTP/1.1" 200 None
2026-03-30 11:41:22 [auto1.fr] INFO: Scrape type for EC92404: 0
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: RT28275
2026-03-30 11:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT28275%27 HTTP/1.1" 200 None
2026-03-30 11:41:22 [auto1.fr] INFO: Scrape type for RT28275: 0
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: ZR52177
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: TU85207
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: PP22658
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: FA63031
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: ZN72586
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: TB94788
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: PL18691
2026-03-30 11:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL18691%27 HTTP/1.1" 200 None
2026-03-30 11:41:22 [auto1.fr] INFO: Scrape type for PL18691: 0
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: DV16573
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: EX41933
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: MP29660
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: SC67193
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: YN87859
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: LF95017
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: ZE07109
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: GN53548
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: CT74820
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: KU74054
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: YF77357
2026-03-30 11:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF77357%27 HTTP/1.1" 200 None
2026-03-30 11:41:22 [auto1.fr] INFO: Scrape type for YF77357: 0
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: GA42142
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: PV02305
2026-03-30 11:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV02305%27 HTTP/1.1" 200 None
2026-03-30 11:41:22 [auto1.fr] INFO: Scrape type for PV02305: 0
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: MP51756
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: ZD51502
2026-03-30 11:41:22 [auto1.fr] INFO: Found listing with ID: LC99897
2026-03-30 11:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LC99897%27 HTTP/1.1" 200 None
2026-03-30 11:41:22 [auto1.fr] INFO: Scrape type for LC99897: 0
2026-03-30 11:41:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:23 [auto1.fr] INFO: Channel: 24h | Page: 55 | totalHits: 5635 | hits on page: 40
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: DT07669
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: NP77756
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: HZ74934
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: JG52598
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: XD22500
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: TY44081
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: NY34669
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY34669%27 HTTP/1.1" 200 None
2026-03-30 11:41:23 [auto1.fr] INFO: Scrape type for NY34669: 0
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: PH25604
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH25604%27 HTTP/1.1" 200 None
2026-03-30 11:41:23 [auto1.fr] INFO: Scrape type for PH25604: 0
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: TC62423
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC62423%27 HTTP/1.1" 200 None
2026-03-30 11:41:23 [auto1.fr] INFO: Scrape type for TC62423: 0
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: BV18579
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: VV84055
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: XG06006
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: TL57355
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: SF38064
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: UK00168
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: CR41152
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR41152%27 HTTP/1.1" 200 None
2026-03-30 11:41:23 [auto1.fr] INFO: Scrape type for CR41152: 0
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: LR91746
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: JR80712
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: VF92026
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: ZE28877
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: ZH49109
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: WP26002
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: EX55572
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: BE65745
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: HX28956
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: VT60963
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: KJ21122
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ21122%27 HTTP/1.1" 200 None
2026-03-30 11:41:23 [auto1.fr] INFO: Scrape type for KJ21122: 0
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: TG79135
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: MN29735
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN29735%27 HTTP/1.1" 200 None
2026-03-30 11:41:23 [auto1.fr] INFO: Scrape type for MN29735: 0
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: TR50266
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: CZ67725
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ67725%27 HTTP/1.1" 200 None
2026-03-30 11:41:23 [auto1.fr] INFO: Scrape type for CZ67725: 0
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: FM97064
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: PM92287
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM92287%27 HTTP/1.1" 200 None
2026-03-30 11:41:23 [auto1.fr] INFO: Scrape type for PM92287: 0
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: SU46956
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU46956%27 HTTP/1.1" 200 None
2026-03-30 11:41:23 [auto1.fr] INFO: Scrape type for SU46956: 0
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: NK33174
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: LS38641
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LS38641%27 HTTP/1.1" 200 None
2026-03-30 11:41:23 [auto1.fr] INFO: Scrape type for LS38641: 0
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: TU74521
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: ZP05634
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: AH24829
2026-03-30 11:41:23 [auto1.fr] INFO: Found listing with ID: ZH03799
2026-03-30 11:41:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:05 [scrapy.extensions.logstats] INFO: Crawled 301 pages (at 2 pages/min), scraped 211 items (at 0 items/min)
2026-03-30 11:42:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:30 [auto1.fr] INFO: Channel: 24h | Page: 56 | totalHits: 5636 | hits on page: 40
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: ZH03799
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: CA82940
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: SN62809
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: JE25024
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: LF35893
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: TB10016
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB10016%27 HTTP/1.1" 200 None
2026-03-30 11:42:30 [auto1.fr] INFO: Scrape type for TB10016: 0
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: AG46745
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: XT19328
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: MA98629
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA98629%27 HTTP/1.1" 200 None
2026-03-30 11:42:30 [auto1.fr] INFO: Scrape type for MA98629: 0
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: AU18258
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: JC63530
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: JD33706
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD33706%27 HTTP/1.1" 200 None
2026-03-30 11:42:30 [auto1.fr] INFO: Scrape type for JD33706: 0
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: KM51888
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: PC77336
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: SN09672
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: NY72155
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: ME98781
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: KD43260
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: AH47501
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: ZK94381
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: AF50439
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: AC87017
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: AJ90479
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: JC92691
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: JV74370
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV74370%27 HTTP/1.1" 200 None
2026-03-30 11:42:30 [auto1.fr] INFO: Scrape type for JV74370: 0
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: UY73638
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY73638%27 HTTP/1.1" 200 None
2026-03-30 11:42:30 [auto1.fr] INFO: Scrape type for UY73638: 0
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: LN94323
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN94323%27 HTTP/1.1" 200 None
2026-03-30 11:42:30 [auto1.fr] INFO: Scrape type for LN94323: 0
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: AT53990
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: FW88695
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW88695%27 HTTP/1.1" 200 None
2026-03-30 11:42:30 [auto1.fr] INFO: Scrape type for FW88695: 0
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: ZP57613
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP57613%27 HTTP/1.1" 200 None
2026-03-30 11:42:30 [auto1.fr] INFO: Scrape type for ZP57613: 0
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: RP29957
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: KC57362
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: JJ37583
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: HC29428
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC29428%27 HTTP/1.1" 200 None
2026-03-30 11:42:30 [auto1.fr] INFO: Scrape type for HC29428: 0
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: VJ34092
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: EP39805
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: HA84537
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: JA27563
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: UJ99205
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ99205%27 HTTP/1.1" 200 None
2026-03-30 11:42:30 [auto1.fr] INFO: Scrape type for UJ99205: 0
2026-03-30 11:42:30 [auto1.fr] INFO: Found listing with ID: JT61248
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT61248%27 HTTP/1.1" 200 None
2026-03-30 11:42:30 [auto1.fr] INFO: Scrape type for JT61248: 2
2026-03-30 11:42:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b374b632-f589-558d-a736-3ff4b5f85f7e with identifier: JT61248
2026-03-30 11:42:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b374b632-f589-558d-a736-3ff4b5f85f7e with scrape type 2
2026-03-30 11:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b374b632-f589-558d-a736-3ff4b5f85f7e with scrape type 2
2026-03-30 11:42:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b374b632-f589-558d-a736-3ff4b5f85f7e, identifier: JT61248
2026-03-30 11:42:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b374b632-f589-558d-a736-3ff4b5f85f7e with identifier: JT61248
2026-03-30 11:42:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b374b632-f589-558d-a736-3ff4b5f85f7e with identifier: JT61248
2026-03-30 11:42:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b374b632-f589-558d-a736-3ff4b5f85f7e with identifier: JT61248 to the API
2026-03-30 11:42:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:42:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:42:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:05:06Z',
'fuel_type': 'diesel',
'id': 'b374b632-f589-558d-a736-3ff4b5f85f7e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT61248',
'listing': 'auction',
'make': 'Nissan',
'model': 'X-Trail',
'odometer': 89511,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-03',
'seller_name': None,
'title': 'Nissan X-Trail 1.6 dCi Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2017}
2026-03-30 11:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT61248%27 HTTP/1.1" 200 None
2026-03-30 11:42:31 [auto1.fr] INFO: Saving data for JT61248: {'auction_closing_time': 1774883106.0, 'created_time': 1774598732.608423, 'last_price_update_time': 1774870951.78405}
2026-03-30 11:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JT61248') HTTP/1.1" 204 0
2026-03-30 11:42:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:40 [auto1.fr] INFO: Channel: 24h | Page: 57 | totalHits: 5636 | hits on page: 40
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: YX89614
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: JR82989
2026-03-30 11:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR82989%27 HTTP/1.1" 200 None
2026-03-30 11:42:40 [auto1.fr] INFO: Scrape type for JR82989: 0
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: VA30172
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: BY18766
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: CV46640
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: BA13556
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: SR59362
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: DB73800
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: CY35541
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: VY23598
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: EW25669
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: NC30245
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: SZ11122
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: AA39852
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: AH64562
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: RB15583
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: BL29340
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: EA19907
2026-03-30 11:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EA19907%27 HTTP/1.1" 200 None
2026-03-30 11:42:40 [auto1.fr] INFO: Scrape type for EA19907: 0
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: FA92478
2026-03-30 11:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA92478%27 HTTP/1.1" 200 None
2026-03-30 11:42:40 [auto1.fr] INFO: Scrape type for FA92478: 0
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: TW66380
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: LD32912
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: MG74963
2026-03-30 11:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG74963%27 HTTP/1.1" 200 None
2026-03-30 11:42:40 [auto1.fr] INFO: Scrape type for MG74963: 0
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: JK90001
2026-03-30 11:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK90001%27 HTTP/1.1" 200 None
2026-03-30 11:42:40 [auto1.fr] INFO: Scrape type for JK90001: 0
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: GH74001
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: JP88493
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: CM31104
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: PU00205
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: DD15144
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: EY42183
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: WH33873
2026-03-30 11:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WH33873%27 HTTP/1.1" 200 None
2026-03-30 11:42:40 [auto1.fr] INFO: Scrape type for WH33873: 0
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: GG04069
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: LK13719
2026-03-30 11:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK13719%27 HTTP/1.1" 200 None
2026-03-30 11:42:40 [auto1.fr] INFO: Scrape type for LK13719: 0
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: ZG98444
2026-03-30 11:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG98444%27 HTTP/1.1" 200 None
2026-03-30 11:42:40 [auto1.fr] INFO: Scrape type for ZG98444: 0
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: WV24696
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: UL24902
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: UJ01372
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: JE42502
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: AW82171
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: MU41007
2026-03-30 11:42:40 [auto1.fr] INFO: Found listing with ID: GE21406
2026-03-30 11:42:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:44 [auto1.fr] INFO: Channel: 24h | Page: 58 | totalHits: 5636 | hits on page: 40
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: CN46028
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN46028%27 HTTP/1.1" 200 None
2026-03-30 11:42:44 [auto1.fr] INFO: Scrape type for CN46028: 0
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: AE81077
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: BV34900
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: SP92026
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: FK21220
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: JM91807
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: BZ44526
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: PV06575
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV06575%27 HTTP/1.1" 200 None
2026-03-30 11:42:44 [auto1.fr] INFO: Scrape type for PV06575: 0
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: LR31340
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: XJ18197
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: LB42344
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB42344%27 HTTP/1.1" 200 None
2026-03-30 11:42:44 [auto1.fr] INFO: Scrape type for LB42344: 0
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: KX68633
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX68633%27 HTTP/1.1" 200 None
2026-03-30 11:42:44 [auto1.fr] INFO: Scrape type for KX68633: 0
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: TP39413
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: GD84631
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD84631%27 HTTP/1.1" 200 None
2026-03-30 11:42:44 [auto1.fr] INFO: Scrape type for GD84631: 0
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: ER76150
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER76150%27 HTTP/1.1" 200 None
2026-03-30 11:42:44 [auto1.fr] INFO: Scrape type for ER76150: 0
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: ZD25027
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: WK47004
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: PW97821
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: RB35100
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: DG55919
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG55919%27 HTTP/1.1" 200 None
2026-03-30 11:42:44 [auto1.fr] INFO: Scrape type for DG55919: 0
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: HU37574
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HU37574%27 HTTP/1.1" 200 None
2026-03-30 11:42:44 [auto1.fr] INFO: Scrape type for HU37574: 0
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: RC66576
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: SK80550
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: PH03582
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: LG44666
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: FK53270
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: CP91356
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: JS50473
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: JG42722
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG42722%27 HTTP/1.1" 200 None
2026-03-30 11:42:44 [auto1.fr] INFO: Scrape type for JG42722: 0
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: BG84980
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG84980%27 HTTP/1.1" 200 None
2026-03-30 11:42:44 [auto1.fr] INFO: Scrape type for BG84980: 0
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: DR15308
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: AF12539
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: FB24526
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB24526%27 HTTP/1.1" 200 None
2026-03-30 11:42:44 [auto1.fr] INFO: Scrape type for FB24526: 0
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: XR44200
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR44200%27 HTTP/1.1" 200 None
2026-03-30 11:42:44 [auto1.fr] INFO: Scrape type for XR44200: 0
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: LP08124
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: NG77796
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: FW97014
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: NN79870
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: PU87091
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU87091%27 HTTP/1.1" 200 None
2026-03-30 11:42:44 [auto1.fr] INFO: Scrape type for PU87091: 0
2026-03-30 11:42:44 [auto1.fr] INFO: Found listing with ID: NK62670
2026-03-30 11:42:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:45 [auto1.fr] INFO: Channel: 24h | Page: 59 | totalHits: 5636 | hits on page: 40
2026-03-30 11:42:45 [auto1.fr] INFO: Found listing with ID: XZ70385
2026-03-30 11:42:45 [auto1.fr] INFO: Found listing with ID: AF52085
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF52085%27 HTTP/1.1" 200 None
2026-03-30 11:42:45 [auto1.fr] INFO: Scrape type for AF52085: 0
2026-03-30 11:42:45 [auto1.fr] INFO: Found listing with ID: LK29548
2026-03-30 11:42:45 [auto1.fr] INFO: Found listing with ID: CF81227
2026-03-30 11:42:45 [auto1.fr] INFO: Found listing with ID: VL86622
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL86622%27 HTTP/1.1" 200 None
2026-03-30 11:42:45 [auto1.fr] INFO: Scrape type for VL86622: 0
2026-03-30 11:42:45 [auto1.fr] INFO: Found listing with ID: ZT34794
2026-03-30 11:42:45 [auto1.fr] INFO: Found listing with ID: NK65339
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK65339%27 HTTP/1.1" 200 None
2026-03-30 11:42:45 [auto1.fr] INFO: Scrape type for NK65339: 0
2026-03-30 11:42:45 [auto1.fr] INFO: Found listing with ID: VX38493
2026-03-30 11:42:45 [auto1.fr] INFO: Found listing with ID: ML40438
2026-03-30 11:42:45 [auto1.fr] INFO: Found listing with ID: MB04633
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB04633%27 HTTP/1.1" 200 None
2026-03-30 11:42:45 [auto1.fr] INFO: Scrape type for MB04633: 0
2026-03-30 11:42:45 [auto1.fr] INFO: Found listing with ID: LL39626
2026-03-30 11:42:45 [auto1.fr] INFO: Found listing with ID: LW80983
2026-03-30 11:42:45 [auto1.fr] INFO: Found listing with ID: FA89683
2026-03-30 11:42:45 [auto1.fr] INFO: Found listing with ID: RG50981
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG50981%27 HTTP/1.1" 200 None
2026-03-30 11:42:45 [auto1.fr] INFO: Scrape type for RG50981: 0
2026-03-30 11:42:45 [auto1.fr] INFO: Found listing with ID: JE03173
2026-03-30 11:42:45 [auto1.fr] INFO: Found listing with ID: BL60402
2026-03-30 11:42:45 [auto1.fr] INFO: Found listing with ID: MG51010
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG51010%27 HTTP/1.1" 200 None
2026-03-30 11:42:45 [auto1.fr] INFO: Scrape type for MG51010: 0
2026-03-30 11:42:45 [auto1.fr] INFO: Found listing with ID: UY32171
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY32171%27 HTTP/1.1" 200 None
2026-03-30 11:42:45 [auto1.fr] INFO: Scrape type for UY32171: 2
2026-03-30 11:42:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5567dc23-c101-5875-b1a3-99db722c870c with identifier: UY32171
2026-03-30 11:42:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5567dc23-c101-5875-b1a3-99db722c870c with scrape type 2
2026-03-30 11:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5567dc23-c101-5875-b1a3-99db722c870c with scrape type 2
2026-03-30 11:42:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5567dc23-c101-5875-b1a3-99db722c870c, identifier: UY32171
2026-03-30 11:42:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5567dc23-c101-5875-b1a3-99db722c870c with identifier: UY32171
2026-03-30 11:42:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5567dc23-c101-5875-b1a3-99db722c870c with identifier: UY32171
2026-03-30 11:42:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5567dc23-c101-5875-b1a3-99db722c870c with identifier: UY32171 to the API
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:42:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:42:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 107,
'expiration_date': '2026-03-30T15:17:43Z',
'fuel_type': 'diesel',
'id': '5567dc23-c101-5875-b1a3-99db722c870c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY32171',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 142589,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-25',
'seller_name': None,
'title': 'Dacia Duster 1.5 dCi Laureate 4x2',
'transmission': 'manual',
'trim': 'Laureate 4x2',
'year': 2013}
2026-03-30 11:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY32171%27 HTTP/1.1" 200 None
2026-03-30 11:42:46 [auto1.fr] INFO: Saving data for UY32171: {'auction_closing_time': 1774883863.0, 'created_time': 1774278490.132796, 'last_price_update_time': 1774870966.159207}
2026-03-30 11:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UY32171') HTTP/1.1" 204 0
2026-03-30 11:42:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: JZ82323
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: SX08243
2026-03-30 11:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX08243%27 HTTP/1.1" 200 None
2026-03-30 11:42:46 [auto1.fr] INFO: Scrape type for SX08243: 0
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: CV72886
2026-03-30 11:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV72886%27 HTTP/1.1" 200 None
2026-03-30 11:42:46 [auto1.fr] INFO: Scrape type for CV72886: 0
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: HY23832
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: KL38579
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: UE86945
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: XR48049
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: VC64518
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: ST83170
2026-03-30 11:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST83170%27 HTTP/1.1" 200 None
2026-03-30 11:42:46 [auto1.fr] INFO: Scrape type for ST83170: 0
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: WA39338
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: DF07976
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: NP36822
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: NT69401
2026-03-30 11:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT69401%27 HTTP/1.1" 200 None
2026-03-30 11:42:46 [auto1.fr] INFO: Scrape type for NT69401: 0
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: CZ26869
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: YJ25040
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: XP38308
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: MC85003
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: YF42365
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: ZX95297
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: NW99513
2026-03-30 11:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW99513%27 HTTP/1.1" 200 None
2026-03-30 11:42:46 [auto1.fr] INFO: Scrape type for NW99513: 0
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: ZG92174
2026-03-30 11:42:46 [auto1.fr] INFO: Found listing with ID: AE65040
2026-03-30 11:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:47 [auto1.fr] INFO: Channel: 24h | Page: 60 | totalHits: 5636 | hits on page: 40
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: LX15810
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: LG43899
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: WR79626
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: VZ24992
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: DZ98417
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: LW97078
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW97078%27 HTTP/1.1" 200 None
2026-03-30 11:42:47 [auto1.fr] INFO: Scrape type for LW97078: 0
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: MA74092
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA74092%27 HTTP/1.1" 200 None
2026-03-30 11:42:47 [auto1.fr] INFO: Scrape type for MA74092: 0
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: AA24621
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: LP13709
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: CL77930
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: YR35791
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: LF36000
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF36000%27 HTTP/1.1" 200 None
2026-03-30 11:42:47 [auto1.fr] INFO: Scrape type for LF36000: 0
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: DN50039
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: PL62181
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL62181%27 HTTP/1.1" 200 None
2026-03-30 11:42:47 [auto1.fr] INFO: Scrape type for PL62181: 0
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: PB58731
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: FB13135
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: ST25881
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: FH84057
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: BB34695
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BB34695%27 HTTP/1.1" 200 None
2026-03-30 11:42:47 [auto1.fr] INFO: Scrape type for BB34695: 0
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: CL59347
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL59347%27 HTTP/1.1" 200 None
2026-03-30 11:42:47 [auto1.fr] INFO: Scrape type for CL59347: 0
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: SB04803
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: UN71549
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: JW24399
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: EV12073
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: PK02389
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: EB64287
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: UV36070
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV36070%27 HTTP/1.1" 200 None
2026-03-30 11:42:47 [auto1.fr] INFO: Scrape type for UV36070: 0
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: ZA24421
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: SB45845
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: DS80497
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: GY91282
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: LA50996
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA50996%27 HTTP/1.1" 200 None
2026-03-30 11:42:47 [auto1.fr] INFO: Scrape type for LA50996: 0
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: CR90071
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR90071%27 HTTP/1.1" 200 None
2026-03-30 11:42:47 [auto1.fr] INFO: Scrape type for CR90071: 0
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: ZA28436
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: ZN04187
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: LZ58861
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: CZ34892
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: UR21858
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: GD59755
2026-03-30 11:42:47 [auto1.fr] INFO: Found listing with ID: MG18417
2026-03-30 11:42:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:05 [scrapy.extensions.logstats] INFO: Crawled 306 pages (at 5 pages/min), scraped 213 items (at 2 items/min)
2026-03-30 11:43:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:06 [auto1.fr] INFO: Channel: 24h | Page: 61 | totalHits: 5636 | hits on page: 40
2026-03-30 11:43:06 [auto1.fr] INFO: Found listing with ID: TH56615
2026-03-30 11:43:06 [auto1.fr] INFO: Found listing with ID: JW71868
2026-03-30 11:43:06 [auto1.fr] INFO: Found listing with ID: ZN88953
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN88953%27 HTTP/1.1" 200 None
2026-03-30 11:43:06 [auto1.fr] INFO: Scrape type for ZN88953: 0
2026-03-30 11:43:06 [auto1.fr] INFO: Found listing with ID: KY80377
2026-03-30 11:43:06 [auto1.fr] INFO: Found listing with ID: NE01664
2026-03-30 11:43:06 [auto1.fr] INFO: Found listing with ID: JE27295
2026-03-30 11:43:06 [auto1.fr] INFO: Found listing with ID: RH40819
2026-03-30 11:43:06 [auto1.fr] INFO: Found listing with ID: LP67901
2026-03-30 11:43:06 [auto1.fr] INFO: Found listing with ID: FB56561
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB56561%27 HTTP/1.1" 200 None
2026-03-30 11:43:07 [auto1.fr] INFO: Scrape type for FB56561: 0
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: BA07458
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: DM41441
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: ME28777
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME28777%27 HTTP/1.1" 200 None
2026-03-30 11:43:07 [auto1.fr] INFO: Scrape type for ME28777: 0
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: RW33400
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: PH94403
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: DG12666
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG12666%27 HTTP/1.1" 200 None
2026-03-30 11:43:07 [auto1.fr] INFO: Scrape type for DG12666: 0
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: DX46082
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: BN48581
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: JJ76691
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ76691%27 HTTP/1.1" 200 None
2026-03-30 11:43:07 [auto1.fr] INFO: Scrape type for JJ76691: 0
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: TF24091
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF24091%27 HTTP/1.1" 200 None
2026-03-30 11:43:07 [auto1.fr] INFO: Scrape type for TF24091: 0
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: MZ30303
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ30303%27 HTTP/1.1" 200 None
2026-03-30 11:43:07 [auto1.fr] INFO: Scrape type for MZ30303: 0
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: RE39264
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: BV45974
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: NY95881
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: HD17777
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD17777%27 HTTP/1.1" 200 None
2026-03-30 11:43:07 [auto1.fr] INFO: Scrape type for HD17777: 0
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: BJ06852
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: SZ38493
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: SF06933
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: XE16652
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: GP42909
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: ZE29084
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: HH99272
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: NC16788
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: JB26835
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: FA53097
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: KE16259
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: WZ69212
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: FC31311
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC31311%27 HTTP/1.1" 200 None
2026-03-30 11:43:07 [auto1.fr] INFO: Scrape type for FC31311: 0
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: ZT48746
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: SL69311
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: RY63806
2026-03-30 11:43:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:07 [auto1.fr] INFO: Channel: 24h | Page: 62 | totalHits: 5636 | hits on page: 40
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: TL94456
2026-03-30 11:43:07 [auto1.fr] INFO: Found listing with ID: LJ23599
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ23599%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [auto1.fr] INFO: Scrape type for LJ23599: 2
2026-03-30 11:43:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca7a2b5d-1fa5-5b86-b600-50c6d3d79ed3 with identifier: LJ23599
2026-03-30 11:43:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca7a2b5d-1fa5-5b86-b600-50c6d3d79ed3 with scrape type 2
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca7a2b5d-1fa5-5b86-b600-50c6d3d79ed3 with scrape type 2
2026-03-30 11:43:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ca7a2b5d-1fa5-5b86-b600-50c6d3d79ed3, identifier: LJ23599
2026-03-30 11:43:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ca7a2b5d-1fa5-5b86-b600-50c6d3d79ed3 with identifier: LJ23599
2026-03-30 11:43:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ca7a2b5d-1fa5-5b86-b600-50c6d3d79ed3 with identifier: LJ23599
2026-03-30 11:43:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ca7a2b5d-1fa5-5b86-b600-50c6d3d79ed3 with identifier: LJ23599 to the API
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:57:33Z',
'fuel_type': 'diesel',
'id': 'ca7a2b5d-1fa5-5b86-b600-50c6d3d79ed3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ23599',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Viano',
'odometer': 302041,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-11',
'seller_name': None,
'title': 'Mercedes-Benz Viano 2.1 CDI lang Ambiente',
'transmission': 'automatic',
'trim': 'lang Ambiente',
'year': 2012}
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ23599%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [auto1.fr] INFO: Saving data for LJ23599: {'auction_closing_time': 1774886253.0, 'created_time': 1773253822.164743, 'last_price_update_time': 1774870988.59956}
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LJ23599') HTTP/1.1" 204 0
2026-03-30 11:43:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: WK52148
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: ZH46521
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: DV25326
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: NG82505
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: HY25615
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: DP81453
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: MU87717
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: RM64712
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: JB40842
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: EJ86627
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: FY44671
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: JP20158
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: VR60661
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: AS08654
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: HF83029
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: LC56122
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: GJ14263
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ14263%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [auto1.fr] INFO: Scrape type for GJ14263: 0
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: XW06359
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: ZY59301
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: MF96045
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: AP53997
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: AH24592
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: RN66545
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN66545%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [auto1.fr] INFO: Scrape type for RN66545: 0
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: ME61929
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME61929%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [auto1.fr] INFO: Scrape type for ME61929: 0
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: MV97984
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: HA15422
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA15422%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [auto1.fr] INFO: Scrape type for HA15422: 0
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: CA45962
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: XW27351
2026-03-30 11:43:08 [auto1.fr] INFO: Found listing with ID: MB92679
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB92679%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [auto1.fr] INFO: Scrape type for MB92679: 2
2026-03-30 11:43:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7e438f5-3827-5514-a520-3e4d42a263e7 with identifier: MB92679
2026-03-30 11:43:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7e438f5-3827-5514-a520-3e4d42a263e7 with scrape type 2
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7e438f5-3827-5514-a520-3e4d42a263e7 with scrape type 2
2026-03-30 11:43:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a7e438f5-3827-5514-a520-3e4d42a263e7, identifier: MB92679
2026-03-30 11:43:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a7e438f5-3827-5514-a520-3e4d42a263e7 with identifier: MB92679
2026-03-30 11:43:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a7e438f5-3827-5514-a520-3e4d42a263e7 with identifier: MB92679
2026-03-30 11:43:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a7e438f5-3827-5514-a520-3e4d42a263e7 with identifier: MB92679 to the API
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:42:21Z',
'fuel_type': 'hybrid',
'id': 'a7e438f5-3827-5514-a520-3e4d42a263e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB92679',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 99812,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-17',
'seller_name': None,
'title': 'Toyota Yaris 1.5 Hybrid Collection',
'transmission': 'automatic',
'trim': 'Collection',
'year': 2018}
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB92679%27 HTTP/1.1" 200 None
2026-03-30 11:43:09 [auto1.fr] INFO: Saving data for MB92679: {'auction_closing_time': 1774885341.0, 'created_time': 1773918577.48436, 'last_price_update_time': 1774870989.24615}
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MB92679') HTTP/1.1" 204 0
2026-03-30 11:43:09 [auto1.fr] INFO: Found listing with ID: UF46494
2026-03-30 11:43:09 [auto1.fr] INFO: Found listing with ID: XY84696
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XY84696%27 HTTP/1.1" 200 None
2026-03-30 11:43:09 [auto1.fr] INFO: Scrape type for XY84696: 0
2026-03-30 11:43:09 [auto1.fr] INFO: Found listing with ID: WP05272
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP05272%27 HTTP/1.1" 200 None
2026-03-30 11:43:09 [auto1.fr] INFO: Scrape type for WP05272: 0
2026-03-30 11:43:09 [auto1.fr] INFO: Found listing with ID: PA61938
2026-03-30 11:43:09 [auto1.fr] INFO: Found listing with ID: CP43636
2026-03-30 11:43:09 [auto1.fr] INFO: Found listing with ID: TU19412
2026-03-30 11:43:09 [auto1.fr] INFO: Found listing with ID: LY86501
2026-03-30 11:43:09 [auto1.fr] INFO: Found listing with ID: XK39723
2026-03-30 11:43:09 [auto1.fr] INFO: Found listing with ID: HH30633
2026-03-30 11:43:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:10 [auto1.fr] INFO: Channel: 24h | Page: 63 | totalHits: 5636 | hits on page: 40
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: CY51391
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY51391%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [auto1.fr] INFO: Scrape type for CY51391: 0
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: ED77700
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: WF91807
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF91807%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [auto1.fr] INFO: Scrape type for WF91807: 0
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: SR61885
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: RH55621
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH55621%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [auto1.fr] INFO: Scrape type for RH55621: 2
2026-03-30 11:43:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b11bfa7-b0aa-5f97-921b-1c45015d8730 with identifier: RH55621
2026-03-30 11:43:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b11bfa7-b0aa-5f97-921b-1c45015d8730 with scrape type 2
2026-03-30 11:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b11bfa7-b0aa-5f97-921b-1c45015d8730 with scrape type 2
2026-03-30 11:43:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9b11bfa7-b0aa-5f97-921b-1c45015d8730, identifier: RH55621
2026-03-30 11:43:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9b11bfa7-b0aa-5f97-921b-1c45015d8730 with identifier: RH55621
2026-03-30 11:43:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9b11bfa7-b0aa-5f97-921b-1c45015d8730 with identifier: RH55621
2026-03-30 11:43:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9b11bfa7-b0aa-5f97-921b-1c45015d8730 with identifier: RH55621 to the API
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:38:13Z',
'fuel_type': 'petrol',
'id': '9b11bfa7-b0aa-5f97-921b-1c45015d8730',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH55621',
'listing': 'auction',
'make': 'Peugeot',
'model': '5008',
'odometer': 92736,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-20',
'seller_name': None,
'title': 'Peugeot 5008 1.2 PureTech Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2018}
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH55621%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [auto1.fr] INFO: Saving data for RH55621: {'auction_closing_time': 1774885093.0, 'created_time': 1774598728.235, 'last_price_update_time': 1774870990.769074}
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RH55621') HTTP/1.1" 204 0
2026-03-30 11:43:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: VH36096
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: EW06939
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: LJ55936
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: TF32846
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: YJ82057
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ82057%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [auto1.fr] INFO: Scrape type for YJ82057: 0
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: UR13721
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: GW71612
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: JG00729
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: NV74031
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV74031%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [auto1.fr] INFO: Scrape type for NV74031: 0
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: ZD93194
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD93194%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [auto1.fr] INFO: Scrape type for ZD93194: 0
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: AM34513
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM34513%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [auto1.fr] INFO: Scrape type for AM34513: 0
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: KS92279
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: PF70653
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: KY64536
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: ZZ02955
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: GK20775
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: ER73555
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: KJ73736
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ73736%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [auto1.fr] INFO: Scrape type for KJ73736: 0
2026-03-30 11:43:10 [auto1.fr] INFO: Found listing with ID: ZX61890
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX61890%27 HTTP/1.1" 200 None
2026-03-30 11:43:11 [auto1.fr] INFO: Scrape type for ZX61890: 0
2026-03-30 11:43:11 [auto1.fr] INFO: Found listing with ID: DA18549
2026-03-30 11:43:11 [auto1.fr] INFO: Found listing with ID: US68134
2026-03-30 11:43:11 [auto1.fr] INFO: Found listing with ID: VE37691
2026-03-30 11:43:11 [auto1.fr] INFO: Found listing with ID: XB95932
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB95932%27 HTTP/1.1" 200 None
2026-03-30 11:43:11 [auto1.fr] INFO: Scrape type for XB95932: 0
2026-03-30 11:43:11 [auto1.fr] INFO: Found listing with ID: YV06903
2026-03-30 11:43:11 [auto1.fr] INFO: Found listing with ID: NR19676
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR19676%27 HTTP/1.1" 200 None
2026-03-30 11:43:11 [auto1.fr] INFO: Scrape type for NR19676: 0
2026-03-30 11:43:11 [auto1.fr] INFO: Found listing with ID: NU52259
2026-03-30 11:43:11 [auto1.fr] INFO: Found listing with ID: TU62117
2026-03-30 11:43:11 [auto1.fr] INFO: Found listing with ID: EU02451
2026-03-30 11:43:11 [auto1.fr] INFO: Found listing with ID: BF36841
2026-03-30 11:43:11 [auto1.fr] INFO: Found listing with ID: XZ88107
2026-03-30 11:43:11 [auto1.fr] INFO: Found listing with ID: FW13126
2026-03-30 11:43:11 [auto1.fr] INFO: Found listing with ID: LF63128
2026-03-30 11:43:11 [auto1.fr] INFO: Found listing with ID: LX82402
2026-03-30 11:43:11 [auto1.fr] INFO: Found listing with ID: KZ20503
2026-03-30 11:43:11 [auto1.fr] INFO: Found listing with ID: NM76429
2026-03-30 11:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:15 [auto1.fr] INFO: Channel: 24h | Page: 64 | totalHits: 5636 | hits on page: 40
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: TA37014
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: WN05477
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: YP31799
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: YU54792
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: LE68264
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LE68264%27 HTTP/1.1" 200 None
2026-03-30 11:43:15 [auto1.fr] INFO: Scrape type for LE68264: 0
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: HY33556
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: TB10256
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: ZG66012
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG66012%27 HTTP/1.1" 200 None
2026-03-30 11:43:15 [auto1.fr] INFO: Scrape type for ZG66012: 0
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: TX67186
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: PS88531
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS88531%27 HTTP/1.1" 200 None
2026-03-30 11:43:15 [auto1.fr] INFO: Scrape type for PS88531: 0
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: TJ21225
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: DX17259
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: ZS82675
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: ZE27506
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: FM74290
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: VE93538
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: LU04592
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LU04592%27 HTTP/1.1" 200 None
2026-03-30 11:43:15 [auto1.fr] INFO: Scrape type for LU04592: 0
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: HF77781
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: YP09228
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: CY75523
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: CS70768
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: HZ48042
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: EP78358
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: CR91044
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: CN36617
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN36617%27 HTTP/1.1" 200 None
2026-03-30 11:43:15 [auto1.fr] INFO: Scrape type for CN36617: 0
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: RT34728
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT34728%27 HTTP/1.1" 200 None
2026-03-30 11:43:15 [auto1.fr] INFO: Scrape type for RT34728: 0
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: JP99768
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP99768%27 HTTP/1.1" 200 None
2026-03-30 11:43:15 [auto1.fr] INFO: Scrape type for JP99768: 0
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: YM87288
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: UH89831
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: VK03845
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: NE58308
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: RN92241
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN92241%27 HTTP/1.1" 200 None
2026-03-30 11:43:15 [auto1.fr] INFO: Scrape type for RN92241: 0
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: UM61645
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM61645%27 HTTP/1.1" 200 None
2026-03-30 11:43:15 [auto1.fr] INFO: Scrape type for UM61645: 0
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: RD82752
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: LR52033
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: TY13200
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: UM68614
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM68614%27 HTTP/1.1" 200 None
2026-03-30 11:43:15 [auto1.fr] INFO: Scrape type for UM68614: 0
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: FK18806
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: GG15377
2026-03-30 11:43:15 [auto1.fr] INFO: Found listing with ID: DN65032
2026-03-30 11:43:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:19 [auto1.fr] INFO: Channel: 24h | Page: 65 | totalHits: 5636 | hits on page: 40
2026-03-30 11:43:19 [auto1.fr] INFO: Found listing with ID: HV37722
2026-03-30 11:43:19 [auto1.fr] INFO: Found listing with ID: ZU80215
2026-03-30 11:43:19 [auto1.fr] INFO: Found listing with ID: ZC18537
2026-03-30 11:43:19 [auto1.fr] INFO: Found listing with ID: WG48512
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG48512%27 HTTP/1.1" 200 None
2026-03-30 11:43:19 [auto1.fr] INFO: Scrape type for WG48512: 0
2026-03-30 11:43:19 [auto1.fr] INFO: Found listing with ID: DS89614
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS89614%27 HTTP/1.1" 200 None
2026-03-30 11:43:19 [auto1.fr] INFO: Scrape type for DS89614: 0
2026-03-30 11:43:19 [auto1.fr] INFO: Found listing with ID: ZN88696
2026-03-30 11:43:19 [auto1.fr] INFO: Found listing with ID: KP00414
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP00414%27 HTTP/1.1" 200 None
2026-03-30 11:43:19 [auto1.fr] INFO: Scrape type for KP00414: 0
2026-03-30 11:43:19 [auto1.fr] INFO: Found listing with ID: HE24245
2026-03-30 11:43:19 [auto1.fr] INFO: Found listing with ID: GN31601
2026-03-30 11:43:19 [auto1.fr] INFO: Found listing with ID: FA22916
2026-03-30 11:43:19 [auto1.fr] INFO: Found listing with ID: NH18304
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH18304%27 HTTP/1.1" 200 None
2026-03-30 11:43:19 [auto1.fr] INFO: Scrape type for NH18304: 0
2026-03-30 11:43:19 [auto1.fr] INFO: Found listing with ID: EZ41909
2026-03-30 11:43:19 [auto1.fr] INFO: Found listing with ID: XK53138
2026-03-30 11:43:19 [auto1.fr] INFO: Found listing with ID: AD60690
2026-03-30 11:43:19 [auto1.fr] INFO: Found listing with ID: DD37174
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD37174%27 HTTP/1.1" 200 None
2026-03-30 11:43:19 [auto1.fr] INFO: Scrape type for DD37174: 2
2026-03-30 11:43:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f87bb0c0-0849-5e83-adec-38367a5a813c with identifier: DD37174
2026-03-30 11:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f87bb0c0-0849-5e83-adec-38367a5a813c with scrape type 2
2026-03-30 11:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f87bb0c0-0849-5e83-adec-38367a5a813c with scrape type 2
2026-03-30 11:43:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f87bb0c0-0849-5e83-adec-38367a5a813c, identifier: DD37174
2026-03-30 11:43:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f87bb0c0-0849-5e83-adec-38367a5a813c with identifier: DD37174
2026-03-30 11:43:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f87bb0c0-0849-5e83-adec-38367a5a813c with identifier: DD37174
2026-03-30 11:43:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f87bb0c0-0849-5e83-adec-38367a5a813c with identifier: DD37174 to the API
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:14:25Z',
'fuel_type': 'petrol',
'id': 'f87bb0c0-0849-5e83-adec-38367a5a813c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD37174',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 142808,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-10',
'seller_name': None,
'title': 'Renault Clio 0.9 Limited',
'transmission': 'manual',
'trim': 'Limited',
'year': 2019}
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD37174%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [auto1.fr] INFO: Saving data for DD37174: {'auction_closing_time': 1774883665.0, 'created_time': 1773220727.357871, 'last_price_update_time': 1774871000.611686}
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DD37174') HTTP/1.1" 204 0
2026-03-30 11:43:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: YB94762
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB94762%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [auto1.fr] INFO: Scrape type for YB94762: 0
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: SJ49135
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: GB35066
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: GY22095
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: SW79727
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: SM80077
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: UR32802
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: ZJ96401
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ96401%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [auto1.fr] INFO: Scrape type for ZJ96401: 0
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: RK47472
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: BP52445
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP52445%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [auto1.fr] INFO: Scrape type for BP52445: 0
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: YP19788
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP19788%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [auto1.fr] INFO: Scrape type for YP19788: 0
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: LW69486
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: UN94210
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: RE08410
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: PJ05356
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: BL80996
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: TA25140
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: GC59558
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: YY02144
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY02144%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [auto1.fr] INFO: Scrape type for YY02144: 0
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: DX14323
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: XD82556
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD82556%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [auto1.fr] INFO: Scrape type for XD82556: 0
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: NE48697
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE48697%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [auto1.fr] INFO: Scrape type for NE48697: 0
2026-03-30 11:43:20 [auto1.fr] INFO: Found listing with ID: DH58041
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH58041%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [auto1.fr] INFO: Scrape type for DH58041: 2
2026-03-30 11:43:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fff388c8-fc15-59c2-9db6-e4ce24d416f0 with identifier: DH58041
2026-03-30 11:43:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fff388c8-fc15-59c2-9db6-e4ce24d416f0 with scrape type 2
2026-03-30 11:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fff388c8-fc15-59c2-9db6-e4ce24d416f0 with scrape type 2
2026-03-30 11:43:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fff388c8-fc15-59c2-9db6-e4ce24d416f0, identifier: DH58041
2026-03-30 11:43:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fff388c8-fc15-59c2-9db6-e4ce24d416f0 with identifier: DH58041
2026-03-30 11:43:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fff388c8-fc15-59c2-9db6-e4ce24d416f0 with identifier: DH58041
2026-03-30 11:43:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fff388c8-fc15-59c2-9db6-e4ce24d416f0 with identifier: DH58041 to the API
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:40:06Z',
'fuel_type': 'petrol',
'id': 'fff388c8-fc15-59c2-9db6-e4ce24d416f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH58041',
'listing': 'auction',
'make': 'Citroen',
'model': 'C1',
'odometer': 190027,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-07-02',
'seller_name': None,
'title': 'Citroen C1 1.0',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH58041%27 HTTP/1.1" 200 None
2026-03-30 11:43:21 [auto1.fr] INFO: Saving data for DH58041: {'auction_closing_time': 1774885206.0, 'created_time': 1772611614.124904, 'last_price_update_time': 1774871001.28089}
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DH58041') HTTP/1.1" 204 0
2026-03-30 11:43:21 [auto1.fr] INFO: Found listing with ID: LL54380
2026-03-30 11:43:21 [auto1.fr] INFO: Found listing with ID: TJ73572
2026-03-30 11:43:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:29 [auto1.fr] INFO: Channel: 24h | Page: 66 | totalHits: 5636 | hits on page: 40
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: WG65933
2026-03-30 11:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG65933%27 HTTP/1.1" 200 None
2026-03-30 11:43:29 [auto1.fr] INFO: Scrape type for WG65933: 0
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: LB12691
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: VG21530
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: BH83806
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: VW78746
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: EJ20680
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: JA65750
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: FY60997
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: CW57453
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: YE04668
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: FF05657
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: DM53916
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: UT45325
2026-03-30 11:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT45325%27 HTTP/1.1" 200 None
2026-03-30 11:43:29 [auto1.fr] INFO: Scrape type for UT45325: 0
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: TC66195
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: EW66058
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: AF03400
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: LV34988
2026-03-30 11:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LV34988%27 HTTP/1.1" 200 None
2026-03-30 11:43:29 [auto1.fr] INFO: Scrape type for LV34988: 0
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: BJ14554
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: ZB56549
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: NC87774
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: ZG44021
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: CW11845
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: HU86256
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: ZZ85085
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: BC53621
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: DU68004
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: DK20365
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: LY05783
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: KV12360
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: LJ28458
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: WY05301
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: BX41673
2026-03-30 11:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX41673%27 HTTP/1.1" 200 None
2026-03-30 11:43:29 [auto1.fr] INFO: Scrape type for BX41673: 0
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: HZ16592
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: FH35394
2026-03-30 11:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH35394%27 HTTP/1.1" 200 None
2026-03-30 11:43:29 [auto1.fr] INFO: Scrape type for FH35394: 0
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: RC41186
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: DT24749
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: FV84367
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: LX41293
2026-03-30 11:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX41293%27 HTTP/1.1" 200 None
2026-03-30 11:43:29 [auto1.fr] INFO: Scrape type for LX41293: 0
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: FR16299
2026-03-30 11:43:29 [auto1.fr] INFO: Found listing with ID: SL49428
2026-03-30 11:43:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:44:05 [scrapy.extensions.logstats] INFO: Crawled 312 pages (at 6 pages/min), scraped 218 items (at 5 items/min)
2026-03-30 11:44:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:44:06 [auto1.fr] INFO: Channel: 24h | Page: 67 | totalHits: 5637 | hits on page: 40
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: SL49428
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: TU04354
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU04354%27 HTTP/1.1" 200 None
2026-03-30 11:44:06 [auto1.fr] INFO: Scrape type for TU04354: 0
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: FY01445
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: PD26566
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD26566%27 HTTP/1.1" 200 None
2026-03-30 11:44:06 [auto1.fr] INFO: Scrape type for PD26566: 0
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: VN04372
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: SB28370
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB28370%27 HTTP/1.1" 200 None
2026-03-30 11:44:06 [auto1.fr] INFO: Scrape type for SB28370: 0
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: VH77869
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH77869%27 HTTP/1.1" 200 None
2026-03-30 11:44:06 [auto1.fr] INFO: Scrape type for VH77869: 0
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: HX32064
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX32064%27 HTTP/1.1" 200 None
2026-03-30 11:44:06 [auto1.fr] INFO: Scrape type for HX32064: 0
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: RY60991
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: BU45895
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU45895%27 HTTP/1.1" 200 None
2026-03-30 11:44:06 [auto1.fr] INFO: Scrape type for BU45895: 0
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: FR65578
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: UW68583
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: YB71496
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: JT57691
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: LC56171
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: DE66310
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: PN21124
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: ML39661
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: GW37086
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: KE30008
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: CA82316
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA82316%27 HTTP/1.1" 200 None
2026-03-30 11:44:06 [auto1.fr] INFO: Scrape type for CA82316: 0
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: JG75683
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: GU68790
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: ZC05103
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: SP13872
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: XJ64155
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ64155%27 HTTP/1.1" 200 None
2026-03-30 11:44:06 [auto1.fr] INFO: Scrape type for XJ64155: 0
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: YA44056
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA44056%27 HTTP/1.1" 200 None
2026-03-30 11:44:06 [auto1.fr] INFO: Scrape type for YA44056: 0
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: EC27844
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: PF67224
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: AD22883
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: WD03445
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: CS54070
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CS54070%27 HTTP/1.1" 200 None
2026-03-30 11:44:06 [auto1.fr] INFO: Scrape type for CS54070: 0
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: BH53881
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH53881%27 HTTP/1.1" 200 None
2026-03-30 11:44:06 [auto1.fr] INFO: Scrape type for BH53881: 0
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: MU63517
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: HU47329
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: SN51278
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: XD40979
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: NX89795
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: BP94119
2026-03-30 11:44:06 [auto1.fr] INFO: Found listing with ID: KJ71958
2026-03-30 11:44:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:44:15 [auto1.fr] INFO: Channel: 24h | Page: 68 | totalHits: 5637 | hits on page: 40
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: JN99416
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: HT35732
2026-03-30 11:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT35732%27 HTTP/1.1" 200 None
2026-03-30 11:44:15 [auto1.fr] INFO: Scrape type for HT35732: 0
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: TP72102
2026-03-30 11:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP72102%27 HTTP/1.1" 200 None
2026-03-30 11:44:15 [auto1.fr] INFO: Scrape type for TP72102: 0
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: YL47975
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: NR74514
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: YH50907
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: ZP91792
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: EZ48204
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: EZ64228
2026-03-30 11:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ64228%27 HTTP/1.1" 200 None
2026-03-30 11:44:15 [auto1.fr] INFO: Scrape type for EZ64228: 0
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: SS34201
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: DJ36054
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: MC07264
2026-03-30 11:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC07264%27 HTTP/1.1" 200 None
2026-03-30 11:44:15 [auto1.fr] INFO: Scrape type for MC07264: 0
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: AB35212
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: HD32956
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: WP33231
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: PR53810
2026-03-30 11:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR53810%27 HTTP/1.1" 200 None
2026-03-30 11:44:15 [auto1.fr] INFO: Scrape type for PR53810: 0
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: LM65355
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: RL73709
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: XU52959
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: PA58884
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: CA13656
2026-03-30 11:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA13656%27 HTTP/1.1" 200 None
2026-03-30 11:44:15 [auto1.fr] INFO: Scrape type for CA13656: 0
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: JJ60641
2026-03-30 11:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ60641%27 HTTP/1.1" 200 None
2026-03-30 11:44:15 [auto1.fr] INFO: Scrape type for JJ60641: 0
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: GY57891
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: UW65109
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: BS97923
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: EZ48607
2026-03-30 11:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ48607%27 HTTP/1.1" 200 None
2026-03-30 11:44:15 [auto1.fr] INFO: Scrape type for EZ48607: 0
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: ZP24032
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: HL32951
2026-03-30 11:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL32951%27 HTTP/1.1" 200 None
2026-03-30 11:44:15 [auto1.fr] INFO: Scrape type for HL32951: 0
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: KT42068
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: TG40003
2026-03-30 11:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG40003%27 HTTP/1.1" 200 None
2026-03-30 11:44:15 [auto1.fr] INFO: Scrape type for TG40003: 0
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: YA85068
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: MP97358
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: XF57852
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: NV32098
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: HL62573
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: SR88609
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: BS50692
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: VS88094
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: FG79429
2026-03-30 11:44:15 [auto1.fr] INFO: Found listing with ID: SU49210
2026-03-30 11:44:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:44:32 [auto1.fr] INFO: Channel: 24h | Page: 69 | totalHits: 5639 | hits on page: 40
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: FG79429
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: SU49210
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: TN59459
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: AP25780
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AP25780%27 HTTP/1.1" 200 None
2026-03-30 11:44:32 [auto1.fr] INFO: Scrape type for AP25780: 0
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: TW38710
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: CH31722
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: CE20463
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: RY80086
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY80086%27 HTTP/1.1" 200 None
2026-03-30 11:44:32 [auto1.fr] INFO: Scrape type for RY80086: 0
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: MF68068
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: YS19816
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: EY51785
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY51785%27 HTTP/1.1" 200 None
2026-03-30 11:44:32 [auto1.fr] INFO: Scrape type for EY51785: 0
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: YR21354
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: WB99343
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: FV93418
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: FP34263
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: ZX72380
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: SL86101
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL86101%27 HTTP/1.1" 200 None
2026-03-30 11:44:32 [auto1.fr] INFO: Scrape type for SL86101: 0
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: KD34930
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD34930%27 HTTP/1.1" 200 None
2026-03-30 11:44:32 [auto1.fr] INFO: Scrape type for KD34930: 2
2026-03-30 11:44:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4048305-46f7-5657-a67b-4e36a8c01c2c with identifier: KD34930
2026-03-30 11:44:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4048305-46f7-5657-a67b-4e36a8c01c2c with scrape type 2
2026-03-30 11:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4048305-46f7-5657-a67b-4e36a8c01c2c with scrape type 2
2026-03-30 11:44:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d4048305-46f7-5657-a67b-4e36a8c01c2c, identifier: KD34930
2026-03-30 11:44:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d4048305-46f7-5657-a67b-4e36a8c01c2c with identifier: KD34930
2026-03-30 11:44:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d4048305-46f7-5657-a67b-4e36a8c01c2c with identifier: KD34930
2026-03-30 11:44:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d4048305-46f7-5657-a67b-4e36a8c01c2c with identifier: KD34930 to the API
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:44:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:00:31Z',
'fuel_type': 'diesel',
'id': 'd4048305-46f7-5657-a67b-4e36a8c01c2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD34930',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 65223,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-05-14',
'seller_name': None,
'title': 'BMW 1er 118d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2024}
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD34930%27 HTTP/1.1" 200 None
2026-03-30 11:44:32 [auto1.fr] INFO: Saving data for KD34930: {'auction_closing_time': 1774882831.0, 'created_time': 1774598729.960262, 'last_price_update_time': 1774871072.7415}
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KD34930') HTTP/1.1" 204 0
2026-03-30 11:44:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: VF56962
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: CM64733
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: YH20722
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: BS50371
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: SJ52352
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: JW14440
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW14440%27 HTTP/1.1" 200 None
2026-03-30 11:44:32 [auto1.fr] INFO: Scrape type for JW14440: 0
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: KR05983
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: HE99151
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HE99151%27 HTTP/1.1" 200 None
2026-03-30 11:44:32 [auto1.fr] INFO: Scrape type for HE99151: 0
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: YZ98794
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ98794%27 HTTP/1.1" 200 None
2026-03-30 11:44:32 [auto1.fr] INFO: Scrape type for YZ98794: 0
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: BD83043
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: KW36844
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KW36844%27 HTTP/1.1" 200 None
2026-03-30 11:44:32 [auto1.fr] INFO: Scrape type for KW36844: 0
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: SM81092
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM81092%27 HTTP/1.1" 200 None
2026-03-30 11:44:32 [auto1.fr] INFO: Scrape type for SM81092: 0
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: HF07357
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF07357%27 HTTP/1.1" 200 None
2026-03-30 11:44:32 [auto1.fr] INFO: Scrape type for HF07357: 0
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: NG72682
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: FE10352
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: HK53651
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK53651%27 HTTP/1.1" 200 None
2026-03-30 11:44:32 [auto1.fr] INFO: Scrape type for HK53651: 0
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: EN44931
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: VL10728
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: SK72304
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK72304%27 HTTP/1.1" 200 None
2026-03-30 11:44:32 [auto1.fr] INFO: Scrape type for SK72304: 0
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: FB20661
2026-03-30 11:44:32 [auto1.fr] INFO: Found listing with ID: TG10438
2026-03-30 11:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG10438%27 HTTP/1.1" 200 None
2026-03-30 11:44:33 [auto1.fr] INFO: Scrape type for TG10438: 0
2026-03-30 11:44:33 [auto1.fr] INFO: Found listing with ID: XY47803
2026-03-30 11:44:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:44:34 [auto1.fr] INFO: Channel: 24h | Page: 70 | totalHits: 5639 | hits on page: 40
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: LK77739
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: DC22500
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: MC81159
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: PR74126
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: MH88652
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: VV01241
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: YY58229
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: YP40813
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: FF57055
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: XG45775
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: GV75211
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: SP24838
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: EA06873
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: LC26469
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: UE01785
2026-03-30 11:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UE01785%27 HTTP/1.1" 200 None
2026-03-30 11:44:34 [auto1.fr] INFO: Scrape type for UE01785: 0
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: MR67167
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: XW10530
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: RH69177
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: NV60777
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: PZ61504
2026-03-30 11:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ61504%27 HTTP/1.1" 200 None
2026-03-30 11:44:34 [auto1.fr] INFO: Scrape type for PZ61504: 0
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: NV92378
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: HG07398
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: SW40453
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: XR07986
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: VK49050
2026-03-30 11:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK49050%27 HTTP/1.1" 200 None
2026-03-30 11:44:34 [auto1.fr] INFO: Scrape type for VK49050: 0
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: VX89083
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: BP15917
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: KJ21922
2026-03-30 11:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ21922%27 HTTP/1.1" 200 None
2026-03-30 11:44:34 [auto1.fr] INFO: Scrape type for KJ21922: 0
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: HD95891
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: MY07329
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: ZM46379
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: DK89513
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: EF67266
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: HU10551
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: FX38745
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: JL66031
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: UF91610
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: GD00278
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: PK07459
2026-03-30 11:44:34 [auto1.fr] INFO: Found listing with ID: KE39242
2026-03-30 11:44:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:44:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:44:36 [auto1.fr] INFO: Channel: 24h | Page: 71 | totalHits: 5639 | hits on page: 40
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: PH17391
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: AF82357
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: PD84892
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: RM15751
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: BN92934
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: LP15614
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: UJ10906
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: DE76416
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: MG54723
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: CA66055
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: XF32876
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: TE54332
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: AV69583
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: KG30366
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: PU10765
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: RV36444
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: JT22164
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: PB31706
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: FN76549
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: TU96312
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: ZK58934
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: AN11424
2026-03-30 11:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN11424%27 HTTP/1.1" 200 None
2026-03-30 11:44:36 [auto1.fr] INFO: Scrape type for AN11424: 0
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: LY36991
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: TB02827
2026-03-30 11:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB02827%27 HTTP/1.1" 200 None
2026-03-30 11:44:36 [auto1.fr] INFO: Scrape type for TB02827: 0
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: UX50667
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: AD62614
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: EJ01381
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: AC35526
2026-03-30 11:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC35526%27 HTTP/1.1" 200 None
2026-03-30 11:44:36 [auto1.fr] INFO: Scrape type for AC35526: 2
2026-03-30 11:44:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a47e6f5-b661-533a-9557-a734bc6fd7d3 with identifier: AC35526
2026-03-30 11:44:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a47e6f5-b661-533a-9557-a734bc6fd7d3 with scrape type 2
2026-03-30 11:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a47e6f5-b661-533a-9557-a734bc6fd7d3 with scrape type 2
2026-03-30 11:44:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6a47e6f5-b661-533a-9557-a734bc6fd7d3, identifier: AC35526
2026-03-30 11:44:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6a47e6f5-b661-533a-9557-a734bc6fd7d3 with identifier: AC35526
2026-03-30 11:44:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6a47e6f5-b661-533a-9557-a734bc6fd7d3 with identifier: AC35526
2026-03-30 11:44:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6a47e6f5-b661-533a-9557-a734bc6fd7d3 with identifier: AC35526 to the API
2026-03-30 11:44:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:44:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:44:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:37:58Z',
'fuel_type': 'petrol',
'id': '6a47e6f5-b661-533a-9557-a734bc6fd7d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC35526',
'listing': 'auction',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 97747,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-17',
'seller_name': None,
'title': 'Jeep Renegade 1.4 M-Air Longitude FWD',
'transmission': 'automatic',
'trim': 'Longitude FWD',
'year': 2017}
2026-03-30 11:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC35526%27 HTTP/1.1" 200 None
2026-03-30 11:44:36 [auto1.fr] INFO: Saving data for AC35526: {'auction_closing_time': 1774885078.0, 'created_time': 1772878595.04638, 'last_price_update_time': 1774871076.859878}
2026-03-30 11:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AC35526') HTTP/1.1" 204 0
2026-03-30 11:44:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: PK61290
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: YA14366
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: WU97149
2026-03-30 11:44:36 [auto1.fr] INFO: Found listing with ID: CN74208
2026-03-30 11:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN74208%27 HTTP/1.1" 200 None
2026-03-30 11:44:37 [auto1.fr] INFO: Scrape type for CN74208: 0
2026-03-30 11:44:37 [auto1.fr] INFO: Found listing with ID: CP24280
2026-03-30 11:44:37 [auto1.fr] INFO: Found listing with ID: CK51652
2026-03-30 11:44:37 [auto1.fr] INFO: Found listing with ID: JA12306
2026-03-30 11:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA12306%27 HTTP/1.1" 200 None
2026-03-30 11:44:37 [auto1.fr] INFO: Scrape type for JA12306: 0
2026-03-30 11:44:37 [auto1.fr] INFO: Found listing with ID: GN96424
2026-03-30 11:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN96424%27 HTTP/1.1" 200 None
2026-03-30 11:44:37 [auto1.fr] INFO: Scrape type for GN96424: 2
2026-03-30 11:44:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab024e52-68a3-5d68-8afa-7a99626bd4ac with identifier: GN96424
2026-03-30 11:44:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab024e52-68a3-5d68-8afa-7a99626bd4ac with scrape type 2
2026-03-30 11:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab024e52-68a3-5d68-8afa-7a99626bd4ac with scrape type 2
2026-03-30 11:44:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ab024e52-68a3-5d68-8afa-7a99626bd4ac, identifier: GN96424
2026-03-30 11:44:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ab024e52-68a3-5d68-8afa-7a99626bd4ac with identifier: GN96424
2026-03-30 11:44:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ab024e52-68a3-5d68-8afa-7a99626bd4ac with identifier: GN96424
2026-03-30 11:44:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ab024e52-68a3-5d68-8afa-7a99626bd4ac with identifier: GN96424 to the API
2026-03-30 11:44:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:44:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:44:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 292,
'expiration_date': '2026-03-30T15:16:25Z',
'fuel_type': 'hybrid',
'id': 'ab024e52-68a3-5d68-8afa-7a99626bd4ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN96424',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 133242,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-24',
'seller_name': None,
'title': 'BMW X3 xDrive 30e M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2020}
2026-03-30 11:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN96424%27 HTTP/1.1" 200 None
2026-03-30 11:44:37 [auto1.fr] INFO: Saving data for GN96424: {'auction_closing_time': 1774883785.0, 'created_time': 1774598731.390107, 'last_price_update_time': 1774871077.423646}
2026-03-30 11:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GN96424') HTTP/1.1" 204 0
2026-03-30 11:44:37 [auto1.fr] INFO: Found listing with ID: BW49011
2026-03-30 11:44:37 [auto1.fr] INFO: Found listing with ID: TH66103
2026-03-30 11:44:37 [auto1.fr] INFO: Found listing with ID: MN84879
2026-03-30 11:44:37 [auto1.fr] INFO: Found listing with ID: ST02253
2026-03-30 11:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST02253%27 HTTP/1.1" 200 None
2026-03-30 11:44:37 [auto1.fr] INFO: Scrape type for ST02253: 0
2026-03-30 11:44:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:44:38 [auto1.fr] INFO: Channel: 24h | Page: 72 | totalHits: 5639 | hits on page: 40
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: YR08447
2026-03-30 11:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR08447%27 HTTP/1.1" 200 None
2026-03-30 11:44:38 [auto1.fr] INFO: Scrape type for YR08447: 0
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: XN35079
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: SZ67934
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: KL66203
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: GR90333
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: XN22503
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: TE33473
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: UW30758
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: WZ68402
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: AZ71859
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: TD71444
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: BF28159
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: BT51628
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: WR25980
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: TD63753
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: FJ13177
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: YH64719
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: MK39736
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: MR66280
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: UD96350
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: HM08835
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: RG14454
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: VL36376
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: DG97865
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: WJ32121
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: HA38525
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: AG65090
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: NS99377
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: GZ28490
2026-03-30 11:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ28490%27 HTTP/1.1" 200 None
2026-03-30 11:44:38 [auto1.fr] INFO: Scrape type for GZ28490: 0
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: LL99186
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: RD15749
2026-03-30 11:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD15749%27 HTTP/1.1" 200 None
2026-03-30 11:44:38 [auto1.fr] INFO: Scrape type for RD15749: 0
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: TT08692
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: JE44262
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: WD28161
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: KJ93163
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: VU54464
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: MR30597
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: GN36140
2026-03-30 11:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN36140%27 HTTP/1.1" 200 None
2026-03-30 11:44:38 [auto1.fr] INFO: Scrape type for GN36140: 0
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: JX79729
2026-03-30 11:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX79729%27 HTTP/1.1" 200 None
2026-03-30 11:44:38 [auto1.fr] INFO: Scrape type for JX79729: 0
2026-03-30 11:44:38 [auto1.fr] INFO: Found listing with ID: SN55047
2026-03-30 11:44:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:44:39 [auto1.fr] INFO: Channel: 24h | Page: 73 | totalHits: 5639 | hits on page: 40
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: PL96389
2026-03-30 11:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL96389%27 HTTP/1.1" 200 None
2026-03-30 11:44:39 [auto1.fr] INFO: Scrape type for PL96389: 0
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: AA03447
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: HJ62596
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: AL62516
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: BS78071
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: EA32444
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: KX80921
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: WT88401
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: EJ34389
2026-03-30 11:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ34389%27 HTTP/1.1" 200 None
2026-03-30 11:44:39 [auto1.fr] INFO: Scrape type for EJ34389: 0
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: FH45650
2026-03-30 11:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH45650%27 HTTP/1.1" 200 None
2026-03-30 11:44:39 [auto1.fr] INFO: Scrape type for FH45650: 0
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: JD56350
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: LH86313
2026-03-30 11:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH86313%27 HTTP/1.1" 200 None
2026-03-30 11:44:39 [auto1.fr] INFO: Scrape type for LH86313: 0
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: PV10769
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: NM75659
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: JE86987
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: BB60197
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: WH66193
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: FG18910
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: XN88220
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: KP96074
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: MR48084
2026-03-30 11:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR48084%27 HTTP/1.1" 200 None
2026-03-30 11:44:39 [auto1.fr] INFO: Scrape type for MR48084: 0
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: HK55434
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: ZW75075
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: NH00695
2026-03-30 11:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH00695%27 HTTP/1.1" 200 None
2026-03-30 11:44:39 [auto1.fr] INFO: Scrape type for NH00695: 0
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: AW23641
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: FV92886
2026-03-30 11:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV92886%27 HTTP/1.1" 200 None
2026-03-30 11:44:39 [auto1.fr] INFO: Scrape type for FV92886: 0
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: GE79607
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: WF39350
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: UJ42359
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: UP18765
2026-03-30 11:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UP18765%27 HTTP/1.1" 200 None
2026-03-30 11:44:39 [auto1.fr] INFO: Scrape type for UP18765: 0
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: HV44248
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: NA12515
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: WY50698
2026-03-30 11:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY50698%27 HTTP/1.1" 200 None
2026-03-30 11:44:39 [auto1.fr] INFO: Scrape type for WY50698: 0
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: AM89877
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: VJ16113
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: JL95450
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: HK38255
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: XF86216
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: FB44516
2026-03-30 11:44:39 [auto1.fr] INFO: Found listing with ID: WN66374
2026-03-30 11:44:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:45:05 [scrapy.extensions.logstats] INFO: Crawled 319 pages (at 7 pages/min), scraped 221 items (at 3 items/min)
2026-03-30 11:45:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:46:05 [scrapy.extensions.logstats] INFO: Crawled 319 pages (at 0 pages/min), scraped 221 items (at 0 items/min)
2026-03-30 11:46:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:46:49 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.597(s), this was the 1st time calling it.
2026-03-30 11:46:49 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.861214849005801 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:46:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:04 [auto1.fr] INFO: Channel: 24h | Page: 74 | totalHits: 5644 | hits on page: 40
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: JL95450
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: HK38255
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: XF86216
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: FB44516
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: WN66374
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: ZW41305
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW41305%27 HTTP/1.1" 200 None
2026-03-30 11:47:04 [auto1.fr] INFO: Scrape type for ZW41305: 0
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: MU03605
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU03605%27 HTTP/1.1" 200 None
2026-03-30 11:47:04 [auto1.fr] INFO: Scrape type for MU03605: 0
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: WM92951
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: KB27018
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: WR73947
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR73947%27 HTTP/1.1" 200 None
2026-03-30 11:47:04 [auto1.fr] INFO: Scrape type for WR73947: 0
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: RJ58832
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: EP93037
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: AE79151
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: DW58063
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DW58063%27 HTTP/1.1" 200 None
2026-03-30 11:47:04 [auto1.fr] INFO: Scrape type for DW58063: 0
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: CK34687
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: VU18877
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: RC47283
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: RV82237
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: MV38237
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV38237%27 HTTP/1.1" 200 None
2026-03-30 11:47:04 [auto1.fr] INFO: Scrape type for MV38237: 0
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: UC41776
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC41776%27 HTTP/1.1" 200 None
2026-03-30 11:47:04 [auto1.fr] INFO: Scrape type for UC41776: 0
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: LH59532
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: YZ25603
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: ZX76031
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: FJ53176
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ53176%27 HTTP/1.1" 200 None
2026-03-30 11:47:04 [auto1.fr] INFO: Scrape type for FJ53176: 0
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: VV03230
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV03230%27 HTTP/1.1" 200 None
2026-03-30 11:47:04 [auto1.fr] INFO: Scrape type for VV03230: 0
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: NL35119
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: BT09994
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT09994%27 HTTP/1.1" 200 None
2026-03-30 11:47:04 [auto1.fr] INFO: Scrape type for BT09994: 0
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: GF71204
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF71204%27 HTTP/1.1" 200 None
2026-03-30 11:47:04 [auto1.fr] INFO: Scrape type for GF71204: 0
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: LK56634
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK56634%27 HTTP/1.1" 200 None
2026-03-30 11:47:04 [auto1.fr] INFO: Scrape type for LK56634: 0
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: CW25524
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW25524%27 HTTP/1.1" 200 None
2026-03-30 11:47:04 [auto1.fr] INFO: Scrape type for CW25524: 0
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: GG97568
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: LV44843
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: NM26270
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM26270%27 HTTP/1.1" 200 None
2026-03-30 11:47:04 [auto1.fr] INFO: Scrape type for NM26270: 0
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: XM00251
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: WD76937
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: RX46777
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX46777%27 HTTP/1.1" 200 None
2026-03-30 11:47:04 [auto1.fr] INFO: Scrape type for RX46777: 0
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: PV30475
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: SB54153
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: AR21211
2026-03-30 11:47:04 [auto1.fr] INFO: Found listing with ID: WB89018
2026-03-30 11:47:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:05 [scrapy.extensions.logstats] INFO: Crawled 320 pages (at 1 pages/min), scraped 221 items (at 0 items/min)
2026-03-30 11:47:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:13 [auto1.fr] INFO: Channel: 24h | Page: 75 | totalHits: 5644 | hits on page: 40
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: EN44572
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: WC58866
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: XC37061
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC37061%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for XC37061: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: PT34048
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PT34048%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for PT34048: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: GU83359
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: MN20136
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN20136%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for MN20136: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: LU48556
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: NL55283
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: DJ94370
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: CX35664
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: WF62835
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: MP37230
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP37230%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for MP37230: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: BT87055
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: CY58026
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: EG28153
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: XE89034
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: MN45068
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: FT35278
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: PB11063
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: NJ96194
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: YF50761
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF50761%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for YF50761: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: PM18360
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM18360%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for PM18360: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: NC58011
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC58011%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for NC58011: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: CM70145
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM70145%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for CM70145: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: MB50972
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: UU55981
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: SE73326
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE73326%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for SE73326: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: LC32715
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LC32715%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for LC32715: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: UJ66435
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ66435%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for UJ66435: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: YD67863
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: RS97852
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RS97852%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for RS97852: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: HB54431
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: AS39169
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: CD37967
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: KD92419
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: TA93484
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: RX27551
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: RT88625
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: CY95378
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: CR40793
2026-03-30 11:47:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:15 [auto1.fr] INFO: Channel: 24h | Page: 76 | totalHits: 5645 | hits on page: 40
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: CR40793
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: LJ02377
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: EC48292
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: FX48416
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: SZ34365
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: MR10401
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: GB20094
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: SX24822
2026-03-30 11:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX24822%27 HTTP/1.1" 200 None
2026-03-30 11:47:15 [auto1.fr] INFO: Scrape type for SX24822: 0
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: PZ84234
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: SK77137
2026-03-30 11:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK77137%27 HTTP/1.1" 200 None
2026-03-30 11:47:15 [auto1.fr] INFO: Scrape type for SK77137: 0
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: YK25648
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: XX30177
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: PV64088
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: JZ71794
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: XS84843
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: NH09710
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: PL24747
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: CV86369
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: NC07430
2026-03-30 11:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC07430%27 HTTP/1.1" 200 None
2026-03-30 11:47:15 [auto1.fr] INFO: Scrape type for NC07430: 0
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: YL72206
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: SC02354
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: HL90015
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: SD22312
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: BD15289
2026-03-30 11:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD15289%27 HTTP/1.1" 200 None
2026-03-30 11:47:15 [auto1.fr] INFO: Scrape type for BD15289: 0
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: VZ14253
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: RV62739
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: DS55428
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: RA78883
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: MK59725
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: RL47353
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: JA80811
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: EH70611
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: UL76778
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: RT00764
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: GG69928
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: WA63272
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: FL64109
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: FW06573
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: GX13152
2026-03-30 11:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GX13152%27 HTTP/1.1" 200 None
2026-03-30 11:47:15 [auto1.fr] INFO: Scrape type for GX13152: 0
2026-03-30 11:47:15 [auto1.fr] INFO: Found listing with ID: DK42079
2026-03-30 11:47:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:16 [auto1.fr] INFO: Channel: 24h | Page: 77 | totalHits: 5645 | hits on page: 40
2026-03-30 11:47:16 [auto1.fr] INFO: Found listing with ID: CT44100
2026-03-30 11:47:16 [auto1.fr] INFO: Found listing with ID: SW43155
2026-03-30 11:47:16 [auto1.fr] INFO: Found listing with ID: ZW70913
2026-03-30 11:47:16 [auto1.fr] INFO: Found listing with ID: LE44996
2026-03-30 11:47:16 [auto1.fr] INFO: Found listing with ID: SN00260
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN00260%27 HTTP/1.1" 200 None
2026-03-30 11:47:16 [auto1.fr] INFO: Scrape type for SN00260: 0
2026-03-30 11:47:16 [auto1.fr] INFO: Found listing with ID: AT92001
2026-03-30 11:47:16 [auto1.fr] INFO: Found listing with ID: DW69865
2026-03-30 11:47:16 [auto1.fr] INFO: Found listing with ID: GW91751
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW91751%27 HTTP/1.1" 200 None
2026-03-30 11:47:17 [auto1.fr] INFO: Scrape type for GW91751: 0
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: CL71953
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL71953%27 HTTP/1.1" 200 None
2026-03-30 11:47:17 [auto1.fr] INFO: Scrape type for CL71953: 0
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: NT63843
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: HK91358
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: SP86966
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: ZD00723
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD00723%27 HTTP/1.1" 200 None
2026-03-30 11:47:17 [auto1.fr] INFO: Scrape type for ZD00723: 0
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: UM04459
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: CC92766
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC92766%27 HTTP/1.1" 200 None
2026-03-30 11:47:17 [auto1.fr] INFO: Scrape type for CC92766: 0
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: MG52410
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG52410%27 HTTP/1.1" 200 None
2026-03-30 11:47:17 [auto1.fr] INFO: Scrape type for MG52410: 0
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: JF27799
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF27799%27 HTTP/1.1" 200 None
2026-03-30 11:47:17 [auto1.fr] INFO: Scrape type for JF27799: 0
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: BJ02880
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: GU08558
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU08558%27 HTTP/1.1" 200 None
2026-03-30 11:47:17 [auto1.fr] INFO: Scrape type for GU08558: 2
2026-03-30 11:47:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b56262d-27f1-5e26-bf82-e057685d09e8 with identifier: GU08558
2026-03-30 11:47:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b56262d-27f1-5e26-bf82-e057685d09e8 with scrape type 2
2026-03-30 11:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b56262d-27f1-5e26-bf82-e057685d09e8 with scrape type 2
2026-03-30 11:47:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6b56262d-27f1-5e26-bf82-e057685d09e8, identifier: GU08558
2026-03-30 11:47:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6b56262d-27f1-5e26-bf82-e057685d09e8 with identifier: GU08558
2026-03-30 11:47:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6b56262d-27f1-5e26-bf82-e057685d09e8 with identifier: GU08558
2026-03-30 11:47:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6b56262d-27f1-5e26-bf82-e057685d09e8 with identifier: GU08558 to the API
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:29:11Z',
'fuel_type': 'petrol',
'id': '6b56262d-27f1-5e26-bf82-e057685d09e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU08558',
'listing': 'auction',
'make': 'Renault',
'model': 'Talisman',
'odometer': 82000,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-26',
'seller_name': None,
'title': 'Renault Talisman 1.6 TCe Energy Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2017}
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU08558%27 HTTP/1.1" 200 None
2026-03-30 11:47:17 [auto1.fr] INFO: Saving data for GU08558: {'auction_closing_time': 1774884551.0, 'created_time': 1774598729.056826, 'last_price_update_time': 1774871237.782579}
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GU08558') HTTP/1.1" 204 0
2026-03-30 11:47:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: UM07151
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM07151%27 HTTP/1.1" 200 None
2026-03-30 11:47:17 [auto1.fr] INFO: Scrape type for UM07151: 0
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: MC29824
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC29824%27 HTTP/1.1" 200 None
2026-03-30 11:47:17 [auto1.fr] INFO: Scrape type for MC29824: 0
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: JT89211
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT89211%27 HTTP/1.1" 200 None
2026-03-30 11:47:17 [auto1.fr] INFO: Scrape type for JT89211: 0
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: XJ20890
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: FK32012
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: MA64494
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA64494%27 HTTP/1.1" 200 None
2026-03-30 11:47:17 [auto1.fr] INFO: Scrape type for MA64494: 0
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: WR92186
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: FU78733
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: SJ39166
2026-03-30 11:47:17 [auto1.fr] INFO: Found listing with ID: DM90708
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM90708%27 HTTP/1.1" 200 None
2026-03-30 11:47:18 [auto1.fr] INFO: Scrape type for DM90708: 0
2026-03-30 11:47:18 [auto1.fr] INFO: Found listing with ID: NX59406
2026-03-30 11:47:18 [auto1.fr] INFO: Found listing with ID: GN88888
2026-03-30 11:47:18 [auto1.fr] INFO: Found listing with ID: ES34117
2026-03-30 11:47:18 [auto1.fr] INFO: Found listing with ID: PV67397
2026-03-30 11:47:18 [auto1.fr] INFO: Found listing with ID: JM62248
2026-03-30 11:47:18 [auto1.fr] INFO: Found listing with ID: EM22592
2026-03-30 11:47:18 [auto1.fr] INFO: Found listing with ID: AE62259
2026-03-30 11:47:18 [auto1.fr] INFO: Found listing with ID: RY13486
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY13486%27 HTTP/1.1" 200 None
2026-03-30 11:47:18 [auto1.fr] INFO: Scrape type for RY13486: 0
2026-03-30 11:47:18 [auto1.fr] INFO: Found listing with ID: YH09576
2026-03-30 11:47:18 [auto1.fr] INFO: Found listing with ID: GE69927
2026-03-30 11:47:18 [auto1.fr] INFO: Found listing with ID: KT98843
2026-03-30 11:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:24 [auto1.fr] INFO: Channel: 24h | Page: 78 | totalHits: 5646 | hits on page: 40
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: KT98843
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: HG76668
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: TY32113
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: UC91463
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: TK33303
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: YG85972
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG85972%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [auto1.fr] INFO: Scrape type for YG85972: 0
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: XG55278
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: JW77657
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW77657%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [auto1.fr] INFO: Scrape type for JW77657: 0
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: AW28682
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: XR89209
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: WD34390
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: PJ54167
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ54167%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [auto1.fr] INFO: Scrape type for PJ54167: 0
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: VC55884
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: PV07911
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: VT56406
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: NH27113
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: CY59235
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: WD94188
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: DC69819
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: MY73034
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: WY56307
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: JP10882
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: DS06756
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: NS53350
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: TK07331
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK07331%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [auto1.fr] INFO: Scrape type for TK07331: 0
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: LW18098
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: PF25256
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: JL47490
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL47490%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [auto1.fr] INFO: Scrape type for JL47490: 0
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: MD52319
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: PH20400
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: JG76800
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: AW56392
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW56392%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [auto1.fr] INFO: Scrape type for AW56392: 0
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: AW60004
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW60004%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [auto1.fr] INFO: Scrape type for AW60004: 0
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: CB71354
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: MH83825
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH83825%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [auto1.fr] INFO: Scrape type for MH83825: 0
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: XA46482
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: PB90330
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: SY14202
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: DV35805
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV35805%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [auto1.fr] INFO: Scrape type for DV35805: 0
2026-03-30 11:47:24 [auto1.fr] INFO: Found listing with ID: WC87969
2026-03-30 11:47:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:35 [auto1.fr] INFO: Channel: 24h | Page: 79 | totalHits: 5647 | hits on page: 40
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: WC87969
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: XY32232
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: GV63675
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV63675%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for GV63675: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: CF10845
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF10845%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for CF10845: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: NG53401
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: AZ10910
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: RW29244
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW29244%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for RW29244: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: RG36017
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: WA43171
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: SG10065
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG10065%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for SG10065: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: KL49541
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: UX65717
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: DL35493
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: EG75535
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: NB90762
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: AG79296
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AG79296%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for AG79296: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: GA58799
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: NR37515
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR37515%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for NR37515: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: SF65222
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: ZV92236
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: BX98635
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: GU82775
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: SU62459
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: YE57515
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: KH48346
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: GM49581
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: ZY57392
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: AF47912
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: VB97188
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VB97188%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for VB97188: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: VU64752
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: FL56790
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL56790%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for FL56790: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: RG31617
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: XN46316
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN46316%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for XN46316: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: LZ05969
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: HH99307
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: DF54292
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: VD19967
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: HX32872
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: FB66651
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: RH62063
2026-03-30 11:47:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:39 [auto1.fr] INFO: Channel: 24h | Page: 80 | totalHits: 5647 | hits on page: 40
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: MZ34112
2026-03-30 11:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ34112%27 HTTP/1.1" 200 None
2026-03-30 11:47:39 [auto1.fr] INFO: Scrape type for MZ34112: 0
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: XX62371
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: GM21359
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: CA98914
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: ED69892
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: MV66695
2026-03-30 11:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV66695%27 HTTP/1.1" 200 None
2026-03-30 11:47:39 [auto1.fr] INFO: Scrape type for MV66695: 0
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: FT23576
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: GX93676
2026-03-30 11:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GX93676%27 HTTP/1.1" 200 None
2026-03-30 11:47:39 [auto1.fr] INFO: Scrape type for GX93676: 0
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: ZP87456
2026-03-30 11:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP87456%27 HTTP/1.1" 200 None
2026-03-30 11:47:39 [auto1.fr] INFO: Scrape type for ZP87456: 0
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: NZ70784
2026-03-30 11:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ70784%27 HTTP/1.1" 200 None
2026-03-30 11:47:39 [auto1.fr] INFO: Scrape type for NZ70784: 0
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: EX70719
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: BN57568
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: TR87165
2026-03-30 11:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR87165%27 HTTP/1.1" 200 None
2026-03-30 11:47:39 [auto1.fr] INFO: Scrape type for TR87165: 0
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: BZ17018
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: WG55562
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: WV49622
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: FN72377
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: CY10481
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: XA49270
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: TZ60923
2026-03-30 11:47:39 [auto1.fr] INFO: Found listing with ID: RM15020
2026-03-30 11:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM15020%27 HTTP/1.1" 200 None
2026-03-30 11:47:40 [auto1.fr] INFO: Scrape type for RM15020: 0
2026-03-30 11:47:40 [auto1.fr] INFO: Found listing with ID: EE21284
2026-03-30 11:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE21284%27 HTTP/1.1" 200 None
2026-03-30 11:47:40 [auto1.fr] INFO: Scrape type for EE21284: 0
2026-03-30 11:47:40 [auto1.fr] INFO: Found listing with ID: TV81334
2026-03-30 11:47:40 [auto1.fr] INFO: Found listing with ID: GP89936
2026-03-30 11:47:40 [auto1.fr] INFO: Found listing with ID: AT65594
2026-03-30 11:47:40 [auto1.fr] INFO: Found listing with ID: DP32912
2026-03-30 11:47:40 [auto1.fr] INFO: Found listing with ID: UK39038
2026-03-30 11:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK39038%27 HTTP/1.1" 200 None
2026-03-30 11:47:40 [auto1.fr] INFO: Scrape type for UK39038: 0
2026-03-30 11:47:40 [auto1.fr] INFO: Found listing with ID: GY61677
2026-03-30 11:47:40 [auto1.fr] INFO: Found listing with ID: NB90508
2026-03-30 11:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NB90508%27 HTTP/1.1" 200 None
2026-03-30 11:47:40 [auto1.fr] INFO: Scrape type for NB90508: 0
2026-03-30 11:47:40 [auto1.fr] INFO: Found listing with ID: SV20054
2026-03-30 11:47:40 [auto1.fr] INFO: Found listing with ID: WT89988
2026-03-30 11:47:40 [auto1.fr] INFO: Found listing with ID: GA93142
2026-03-30 11:47:40 [auto1.fr] INFO: Found listing with ID: PJ64273
2026-03-30 11:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ64273%27 HTTP/1.1" 200 None
2026-03-30 11:47:40 [auto1.fr] INFO: Scrape type for PJ64273: 0
2026-03-30 11:47:40 [auto1.fr] INFO: Found listing with ID: CX78673
2026-03-30 11:47:40 [auto1.fr] INFO: Found listing with ID: CC24072
2026-03-30 11:47:40 [auto1.fr] INFO: Found listing with ID: PP43098
2026-03-30 11:47:40 [auto1.fr] INFO: Found listing with ID: YB09337
2026-03-30 11:47:40 [auto1.fr] INFO: Found listing with ID: UL03444
2026-03-30 11:47:40 [auto1.fr] INFO: Found listing with ID: UV60412
2026-03-30 11:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV60412%27 HTTP/1.1" 200 None
2026-03-30 11:47:40 [auto1.fr] INFO: Scrape type for UV60412: 0
2026-03-30 11:47:40 [auto1.fr] INFO: Found listing with ID: UF95720
2026-03-30 11:47:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:05 [scrapy.extensions.logstats] INFO: Crawled 326 pages (at 6 pages/min), scraped 222 items (at 1 items/min)
2026-03-30 11:48:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:12 [auto1.fr] INFO: Channel: 24h | Page: 81 | totalHits: 5648 | hits on page: 40
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: UF95720
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: ZN04064
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN04064%27 HTTP/1.1" 200 None
2026-03-30 11:48:12 [auto1.fr] INFO: Scrape type for ZN04064: 0
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: AW37047
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: NM13401
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM13401%27 HTTP/1.1" 200 None
2026-03-30 11:48:12 [auto1.fr] INFO: Scrape type for NM13401: 0
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: NW20165
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: RG52075
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG52075%27 HTTP/1.1" 200 None
2026-03-30 11:48:12 [auto1.fr] INFO: Scrape type for RG52075: 0
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: AA16834
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AA16834%27 HTTP/1.1" 200 None
2026-03-30 11:48:12 [auto1.fr] INFO: Scrape type for AA16834: 0
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: GR99275
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: PV13228
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: EV42623
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: WS35351
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: YP33756
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: XY53140
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: ZU33425
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: AD86983
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: VT20468
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: KH60599
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: XJ63640
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: RM16202
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: RT81456
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT81456%27 HTTP/1.1" 200 None
2026-03-30 11:48:12 [auto1.fr] INFO: Scrape type for RT81456: 0
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: SZ87604
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: CB49566
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: DE63289
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: RE03230
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: WN15233
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN15233%27 HTTP/1.1" 200 None
2026-03-30 11:48:12 [auto1.fr] INFO: Scrape type for WN15233: 0
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: FS07916
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: MU95789
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: FA15560
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: UB67774
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: DF24402
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DF24402%27 HTTP/1.1" 200 None
2026-03-30 11:48:12 [auto1.fr] INFO: Scrape type for DF24402: 0
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: CZ98730
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: YX42017
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: CV73916
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: PU21182
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU21182%27 HTTP/1.1" 200 None
2026-03-30 11:48:12 [auto1.fr] INFO: Scrape type for PU21182: 0
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: JK30699
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK30699%27 HTTP/1.1" 200 None
2026-03-30 11:48:12 [auto1.fr] INFO: Scrape type for JK30699: 0
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: EM57461
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EM57461%27 HTTP/1.1" 200 None
2026-03-30 11:48:12 [auto1.fr] INFO: Scrape type for EM57461: 0
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: XB85686
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: JL35366
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL35366%27 HTTP/1.1" 200 None
2026-03-30 11:48:12 [auto1.fr] INFO: Scrape type for JL35366: 0
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: GR91646
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR91646%27 HTTP/1.1" 200 None
2026-03-30 11:48:12 [auto1.fr] INFO: Scrape type for GR91646: 0
2026-03-30 11:48:12 [auto1.fr] INFO: Found listing with ID: SG49847
2026-03-30 11:48:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:23 [auto1.fr] INFO: Channel: 24h | Page: 82 | totalHits: 5649 | hits on page: 40
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: SG49847
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: CY63463
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: FY67161
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: DL61056
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: MP86931
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: BE28415
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: GV47699
2026-03-30 11:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV47699%27 HTTP/1.1" 200 None
2026-03-30 11:48:23 [auto1.fr] INFO: Scrape type for GV47699: 0
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: EW12246
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: FF06741
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: KJ11601
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: MX50814
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: TB90662
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: DR50582
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: LU25921
2026-03-30 11:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LU25921%27 HTTP/1.1" 200 None
2026-03-30 11:48:23 [auto1.fr] INFO: Scrape type for LU25921: 0
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: AW72790
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: RR87371
2026-03-30 11:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR87371%27 HTTP/1.1" 200 None
2026-03-30 11:48:23 [auto1.fr] INFO: Scrape type for RR87371: 0
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: VB06410
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: MC80505
2026-03-30 11:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC80505%27 HTTP/1.1" 200 None
2026-03-30 11:48:23 [auto1.fr] INFO: Scrape type for MC80505: 0
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: TJ42804
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: TU33968
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: JN75588
2026-03-30 11:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN75588%27 HTTP/1.1" 200 None
2026-03-30 11:48:23 [auto1.fr] INFO: Scrape type for JN75588: 0
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: KU24416
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: CA74367
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: EU98498
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: TP62377
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: PN48147
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: KH41597
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: VT59003
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: EZ33397
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: MM74389
2026-03-30 11:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM74389%27 HTTP/1.1" 200 None
2026-03-30 11:48:23 [auto1.fr] INFO: Scrape type for MM74389: 0
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: WS91599
2026-03-30 11:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS91599%27 HTTP/1.1" 200 None
2026-03-30 11:48:23 [auto1.fr] INFO: Scrape type for WS91599: 0
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: JL73028
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: BU68644
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: HX42637
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: AR11267
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: ZB25731
2026-03-30 11:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB25731%27 HTTP/1.1" 200 None
2026-03-30 11:48:23 [auto1.fr] INFO: Scrape type for ZB25731: 0
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: CZ71555
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: EN45493
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: AF00232
2026-03-30 11:48:23 [auto1.fr] INFO: Found listing with ID: CW03284
2026-03-30 11:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW03284%27 HTTP/1.1" 200 None
2026-03-30 11:48:23 [auto1.fr] INFO: Scrape type for CW03284: 0
2026-03-30 11:48:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:29 [auto1.fr] INFO: Channel: 24h | Page: 83 | totalHits: 5649 | hits on page: 40
2026-03-30 11:48:29 [auto1.fr] INFO: Found listing with ID: AE49772
2026-03-30 11:48:29 [auto1.fr] INFO: Found listing with ID: JT77468
2026-03-30 11:48:29 [auto1.fr] INFO: Found listing with ID: LU41944
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LU41944%27 HTTP/1.1" 200 None
2026-03-30 11:48:29 [auto1.fr] INFO: Scrape type for LU41944: 0
2026-03-30 11:48:29 [auto1.fr] INFO: Found listing with ID: EX69925
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EX69925%27 HTTP/1.1" 200 None
2026-03-30 11:48:29 [auto1.fr] INFO: Scrape type for EX69925: 0
2026-03-30 11:48:29 [auto1.fr] INFO: Found listing with ID: AK98548
2026-03-30 11:48:29 [auto1.fr] INFO: Found listing with ID: HX44098
2026-03-30 11:48:29 [auto1.fr] INFO: Found listing with ID: KU64262
2026-03-30 11:48:29 [auto1.fr] INFO: Found listing with ID: NA45918
2026-03-30 11:48:29 [auto1.fr] INFO: Found listing with ID: EZ74269
2026-03-30 11:48:29 [auto1.fr] INFO: Found listing with ID: AM89267
2026-03-30 11:48:29 [auto1.fr] INFO: Found listing with ID: AN35398
2026-03-30 11:48:29 [auto1.fr] INFO: Found listing with ID: CT72802
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT72802%27 HTTP/1.1" 200 None
2026-03-30 11:48:29 [auto1.fr] INFO: Scrape type for CT72802: 0
2026-03-30 11:48:29 [auto1.fr] INFO: Found listing with ID: HL64257
2026-03-30 11:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL64257%27 HTTP/1.1" 200 None
2026-03-30 11:48:30 [auto1.fr] INFO: Scrape type for HL64257: 0
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: RS33880
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: RU39722
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: DL73854
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: UW62660
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: LX07620
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: SS11031
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: EF99764
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: HS65333
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: FH53651
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: HG41300
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: HC61728
2026-03-30 11:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC61728%27 HTTP/1.1" 200 None
2026-03-30 11:48:30 [auto1.fr] INFO: Scrape type for HC61728: 0
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: VW75527
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: VN17175
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: GJ07777
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: TM51568
2026-03-30 11:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TM51568%27 HTTP/1.1" 200 None
2026-03-30 11:48:30 [auto1.fr] INFO: Scrape type for TM51568: 0
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: GR22766
2026-03-30 11:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR22766%27 HTTP/1.1" 200 None
2026-03-30 11:48:30 [auto1.fr] INFO: Scrape type for GR22766: 0
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: MC48696
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: DG70448
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: HD39413
2026-03-30 11:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD39413%27 HTTP/1.1" 200 None
2026-03-30 11:48:30 [auto1.fr] INFO: Scrape type for HD39413: 0
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: EB39116
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: UW24353
2026-03-30 11:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW24353%27 HTTP/1.1" 200 None
2026-03-30 11:48:30 [auto1.fr] INFO: Scrape type for UW24353: 0
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: LG45977
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: WT70639
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: WS65527
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: RU67717
2026-03-30 11:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU67717%27 HTTP/1.1" 200 None
2026-03-30 11:48:30 [auto1.fr] INFO: Scrape type for RU67717: 0
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: EX24044
2026-03-30 11:48:30 [auto1.fr] INFO: Found listing with ID: TK17800
2026-03-30 11:48:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:49:05 [scrapy.extensions.logstats] INFO: Crawled 329 pages (at 3 pages/min), scraped 222 items (at 0 items/min)
2026-03-30 11:49:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:50:05 [scrapy.extensions.logstats] INFO: Crawled 329 pages (at 0 pages/min), scraped 222 items (at 0 items/min)
2026-03-30 11:50:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:50:40 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.739(s), this was the 1st time calling it.
2026-03-30 11:50:40 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.850134629384869 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:50:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:04 [auto1.fr] INFO: Channel: 24h | Page: 84 | totalHits: 5654 | hits on page: 40
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: WT70639
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: WS65527
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: RU67717
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU67717%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.fr] INFO: Scrape type for RU67717: 0
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: EX24044
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: TK17800
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: VJ61916
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: SL23162
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: MW37619
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MW37619%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.fr] INFO: Scrape type for MW37619: 0
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: LH72856
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: YE18250
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE18250%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.fr] INFO: Scrape type for YE18250: 0
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: TK69848
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: UP87670
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: GS36765
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: YM41866
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YM41866%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.fr] INFO: Scrape type for YM41866: 0
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: YJ05555
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: SX48678
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: DH82223
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: HL19117
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: GB90259
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: PZ86834
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ86834%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.fr] INFO: Scrape type for PZ86834: 0
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: JW95827
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW95827%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.fr] INFO: Scrape type for JW95827: 0
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: DW86267
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DW86267%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.fr] INFO: Scrape type for DW86267: 0
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: XE12504
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: RM94372
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: BN28845
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: TH22765
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: GM49151
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: NM43411
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM43411%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.fr] INFO: Scrape type for NM43411: 0
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: WZ91942
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: SP79464
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: NH66177
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: AK77190
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK77190%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.fr] INFO: Scrape type for AK77190: 0
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: AF71559
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: WE51663
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: RW48851
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: RY88225
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: MN49775
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN49775%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.fr] INFO: Scrape type for MN49775: 0
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: KL41030
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: FJ03284
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ03284%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.fr] INFO: Scrape type for FJ03284: 0
2026-03-30 11:51:04 [auto1.fr] INFO: Found listing with ID: LN93682
2026-03-30 11:51:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:05 [scrapy.extensions.logstats] INFO: Crawled 330 pages (at 1 pages/min), scraped 222 items (at 0 items/min)
2026-03-30 11:51:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:52:05 [scrapy.extensions.logstats] INFO: Crawled 330 pages (at 0 pages/min), scraped 222 items (at 0 items/min)
2026-03-30 11:52:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:13 [auto1.fr] INFO: Channel: 24h | Page: 85 | totalHits: 5658 | hits on page: 40
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: MN49775
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN49775%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.fr] INFO: Scrape type for MN49775: 0
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: KL41030
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: FJ03284
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ03284%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.fr] INFO: Scrape type for FJ03284: 0
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: LN93682
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: NE89694
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: RN78358
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN78358%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.fr] INFO: Scrape type for RN78358: 0
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: YD65284
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: FM76859
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM76859%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.fr] INFO: Scrape type for FM76859: 0
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: HY23225
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: ZV17346
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: XM63454
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: BK60442
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: JB86111
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB86111%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.fr] INFO: Scrape type for JB86111: 0
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: SK76067
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK76067%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.fr] INFO: Scrape type for SK76067: 0
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: JC04532
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: HP83519
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: FY19911
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: UV68573
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: CU82171
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU82171%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.fr] INFO: Scrape type for CU82171: 0
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: CN94578
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: MX44865
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX44865%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.fr] INFO: Scrape type for MX44865: 0
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: JW66497
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: DZ50190
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: UV66666
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: BF11227
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BF11227%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.fr] INFO: Scrape type for BF11227: 0
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: TW86443
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW86443%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.fr] INFO: Scrape type for TW86443: 0
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: XP13710
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP13710%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.fr] INFO: Scrape type for XP13710: 0
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: ZU63998
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: TD62088
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: NK86276
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: NN52824
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN52824%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.fr] INFO: Scrape type for NN52824: 0
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: BG86110
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG86110%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.fr] INFO: Scrape type for BG86110: 0
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: DC75279
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: MV26699
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: XL06807
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: YS28405
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: KW91019
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: UM24040
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM24040%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.fr] INFO: Scrape type for UM24040: 0
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: TT76332
2026-03-30 11:52:13 [auto1.fr] INFO: Found listing with ID: GY53867
2026-03-30 11:52:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:15 [auto1.fr] INFO: Channel: 24h | Page: 86 | totalHits: 5658 | hits on page: 40
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: DE52492
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: EF80120
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: KS39466
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: SK79513
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: GK27379
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: PR02257
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: FX56042
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: SK90535
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: TK50100
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: BZ72790
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: AB89878
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: WG41079
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: KU95605
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: ML45851
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: SP05715
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: BG55031
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: XJ30987
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ30987%27 HTTP/1.1" 200 None
2026-03-30 11:52:15 [auto1.fr] INFO: Scrape type for XJ30987: 0
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: SG47762
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: XT28721
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: HA75396
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: EK70515
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EK70515%27 HTTP/1.1" 200 None
2026-03-30 11:52:15 [auto1.fr] INFO: Scrape type for EK70515: 0
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: NU07942
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: JY53378
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: VD45259
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: HC41727
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC41727%27 HTTP/1.1" 200 None
2026-03-30 11:52:15 [auto1.fr] INFO: Scrape type for HC41727: 0
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: EH82966
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: CF11578
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: MF04067
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: EE18245
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: WJ64776
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: KV98613
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV98613%27 HTTP/1.1" 200 None
2026-03-30 11:52:15 [auto1.fr] INFO: Scrape type for KV98613: 0
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: VJ77975
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: JZ01678
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: TP14970
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: MG55357
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG55357%27 HTTP/1.1" 200 None
2026-03-30 11:52:15 [auto1.fr] INFO: Scrape type for MG55357: 0
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: EW34119
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: NF12969
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: EW04315
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: BT83384
2026-03-30 11:52:15 [auto1.fr] INFO: Found listing with ID: CE73573
2026-03-30 11:52:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:19 [auto1.fr] INFO: Channel: 24h | Page: 87 | totalHits: 5660 | hits on page: 40
2026-03-30 11:52:19 [auto1.fr] INFO: Found listing with ID: BT83384
2026-03-30 11:52:19 [auto1.fr] INFO: Found listing with ID: CE73573
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: GC95950
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: TU89344
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: XX69546
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XX69546%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.fr] INFO: Scrape type for XX69546: 0
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: WB96726
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB96726%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.fr] INFO: Scrape type for WB96726: 0
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: KV51080
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV51080%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.fr] INFO: Scrape type for KV51080: 0
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: DM04559
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: SF64188
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: RJ85335
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: PN07999
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: SS09336
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: WX45079
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: GG73780
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: WU31753
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: FB73414
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: LG22146
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: DX84857
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: ED22019
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: RU83053
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: XH57355
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: DU53160
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: NJ73263
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: TW26107
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: ZU24116
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: MJ75566
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: MU32424
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: ZD63756
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: SV97892
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: CU45612
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: UZ88065
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: BX46550
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: NK97521
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK97521%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.fr] INFO: Scrape type for NK97521: 0
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: YF60243
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: BF96093
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: XK18597
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK18597%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.fr] INFO: Scrape type for XK18597: 0
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: KK88504
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK88504%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.fr] INFO: Scrape type for KK88504: 0
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: NP72433
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: VV28577
2026-03-30 11:52:20 [auto1.fr] INFO: Found listing with ID: NF02632
2026-03-30 11:52:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:53:05 [scrapy.extensions.logstats] INFO: Crawled 333 pages (at 3 pages/min), scraped 222 items (at 0 items/min)
2026-03-30 11:53:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:54:05 [scrapy.extensions.logstats] INFO: Crawled 333 pages (at 0 pages/min), scraped 222 items (at 0 items/min)
2026-03-30 11:54:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:54:30 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.560(s), this was the 1st time calling it.
2026-03-30 11:54:30 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.144353641735272 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:54:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:55:05 [scrapy.extensions.logstats] INFO: Crawled 333 pages (at 0 pages/min), scraped 222 items (at 0 items/min)
2026-03-30 11:55:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:45 [auto1.fr] INFO: Channel: 24h | Page: 88 | totalHits: 5667 | hits on page: 40
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: YF60243
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: BF96093
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: XK18597
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK18597%27 HTTP/1.1" 200 None
2026-03-30 11:55:45 [auto1.fr] INFO: Scrape type for XK18597: 0
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: KK88504
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK88504%27 HTTP/1.1" 200 None
2026-03-30 11:55:45 [auto1.fr] INFO: Scrape type for KK88504: 0
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: NP72433
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: VV28577
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: NF02632
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: ED65991
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: EU04661
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU04661%27 HTTP/1.1" 200 None
2026-03-30 11:55:45 [auto1.fr] INFO: Scrape type for EU04661: 0
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: AV09040
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: DR66239
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: NF64180
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: PL68032
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: FV54092
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: WB82308
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: PE05498
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: AH27285
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH27285%27 HTTP/1.1" 200 None
2026-03-30 11:55:45 [auto1.fr] INFO: Scrape type for AH27285: 0
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: DF98972
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: UV80375
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: VT28880
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT28880%27 HTTP/1.1" 200 None
2026-03-30 11:55:45 [auto1.fr] INFO: Scrape type for VT28880: 0
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: JB33898
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: XV37084
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV37084%27 HTTP/1.1" 200 None
2026-03-30 11:55:45 [auto1.fr] INFO: Scrape type for XV37084: 0
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: PD03339
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD03339%27 HTTP/1.1" 200 None
2026-03-30 11:55:45 [auto1.fr] INFO: Scrape type for PD03339: 0
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: MT70667
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: UE54565
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: BK69407
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: AD21154
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD21154%27 HTTP/1.1" 200 None
2026-03-30 11:55:45 [auto1.fr] INFO: Scrape type for AD21154: 0
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: UX68185
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX68185%27 HTTP/1.1" 200 None
2026-03-30 11:55:45 [auto1.fr] INFO: Scrape type for UX68185: 0
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: TJ06743
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ06743%27 HTTP/1.1" 200 None
2026-03-30 11:55:45 [auto1.fr] INFO: Scrape type for TJ06743: 0
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: YH95657
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: XC26455
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC26455%27 HTTP/1.1" 200 None
2026-03-30 11:55:45 [auto1.fr] INFO: Scrape type for XC26455: 0
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: TD05048
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: LD33485
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: HE55587
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HE55587%27 HTTP/1.1" 200 None
2026-03-30 11:55:45 [auto1.fr] INFO: Scrape type for HE55587: 0
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: YV70333
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: RE04761
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: FU21313
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: TE23987
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE23987%27 HTTP/1.1" 200 None
2026-03-30 11:55:45 [auto1.fr] INFO: Scrape type for TE23987: 0
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: CU40817
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU40817%27 HTTP/1.1" 200 None
2026-03-30 11:55:45 [auto1.fr] INFO: Scrape type for CU40817: 0
2026-03-30 11:55:45 [auto1.fr] INFO: Found listing with ID: TY25406
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY25406%27 HTTP/1.1" 200 None
2026-03-30 11:55:45 [auto1.fr] INFO: Scrape type for TY25406: 0
2026-03-30 11:55:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:04 [auto1.fr] INFO: Channel: 24h | Page: 89 | totalHits: 5667 | hits on page: 40
2026-03-30 11:56:04 [auto1.fr] INFO: Found listing with ID: MA45879
2026-03-30 11:56:04 [auto1.fr] INFO: Found listing with ID: MU43687
2026-03-30 11:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU43687%27 HTTP/1.1" 200 None
2026-03-30 11:56:04 [auto1.fr] INFO: Scrape type for MU43687: 0
2026-03-30 11:56:04 [auto1.fr] INFO: Found listing with ID: CG53313
2026-03-30 11:56:04 [auto1.fr] INFO: Found listing with ID: VM37248
2026-03-30 11:56:04 [auto1.fr] INFO: Found listing with ID: AS73849
2026-03-30 11:56:04 [auto1.fr] INFO: Found listing with ID: XE65140
2026-03-30 11:56:04 [auto1.fr] INFO: Found listing with ID: KG53026
2026-03-30 11:56:04 [auto1.fr] INFO: Found listing with ID: AT21688
2026-03-30 11:56:04 [auto1.fr] INFO: Found listing with ID: AX11943
2026-03-30 11:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX11943%27 HTTP/1.1" 200 None
2026-03-30 11:56:04 [auto1.fr] INFO: Scrape type for AX11943: 0
2026-03-30 11:56:04 [auto1.fr] INFO: Found listing with ID: TA55744
2026-03-30 11:56:04 [auto1.fr] INFO: Found listing with ID: SN40214
2026-03-30 11:56:04 [auto1.fr] INFO: Found listing with ID: HR76305
2026-03-30 11:56:04 [auto1.fr] INFO: Found listing with ID: AL82018
2026-03-30 11:56:04 [auto1.fr] INFO: Found listing with ID: FF28625
2026-03-30 11:56:04 [auto1.fr] INFO: Found listing with ID: JZ01335
2026-03-30 11:56:04 [auto1.fr] INFO: Found listing with ID: BE73084
2026-03-30 11:56:04 [auto1.fr] INFO: Found listing with ID: KZ06576
2026-03-30 11:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KZ06576%27 HTTP/1.1" 200 None
2026-03-30 11:56:05 [auto1.fr] INFO: Scrape type for KZ06576: 0
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: VG22418
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: XB99079
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: CV80188
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: LZ94034
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: TV18698
2026-03-30 11:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV18698%27 HTTP/1.1" 200 None
2026-03-30 11:56:05 [auto1.fr] INFO: Scrape type for TV18698: 0
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: KK18532
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: RT56886
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: PU00090
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: AZ87418
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: PK59709
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: ML04615
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: AP89415
2026-03-30 11:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AP89415%27 HTTP/1.1" 200 None
2026-03-30 11:56:05 [auto1.fr] INFO: Scrape type for AP89415: 0
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: MF53419
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: EM31372
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: KA12460
2026-03-30 11:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA12460%27 HTTP/1.1" 200 None
2026-03-30 11:56:05 [auto1.fr] INFO: Scrape type for KA12460: 0
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: NZ10281
2026-03-30 11:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ10281%27 HTTP/1.1" 200 None
2026-03-30 11:56:05 [auto1.fr] INFO: Scrape type for NZ10281: 0
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: EC97430
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: AV80485
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: CN29658
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: KK96121
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: WW84487
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: MJ65865
2026-03-30 11:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ65865%27 HTTP/1.1" 200 None
2026-03-30 11:56:05 [auto1.fr] INFO: Scrape type for MJ65865: 0
2026-03-30 11:56:05 [auto1.fr] INFO: Found listing with ID: PB69772
2026-03-30 11:56:05 [scrapy.extensions.logstats] INFO: Crawled 335 pages (at 2 pages/min), scraped 222 items (at 0 items/min)
2026-03-30 11:56:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:56:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:11 [auto1.fr] INFO: Channel: 24h | Page: 90 | totalHits: 5668 | hits on page: 40
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: PB69772
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: ZP43186
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: TZ71501
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ71501%27 HTTP/1.1" 200 None
2026-03-30 11:56:11 [auto1.fr] INFO: Scrape type for TZ71501: 0
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: JP20801
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: BD27690
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD27690%27 HTTP/1.1" 200 None
2026-03-30 11:56:11 [auto1.fr] INFO: Scrape type for BD27690: 0
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: KD15560
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD15560%27 HTTP/1.1" 200 None
2026-03-30 11:56:11 [auto1.fr] INFO: Scrape type for KD15560: 0
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: BV28672
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: CD24187
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: HK16802
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: NZ72826
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ72826%27 HTTP/1.1" 200 None
2026-03-30 11:56:11 [auto1.fr] INFO: Scrape type for NZ72826: 0
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: YL24585
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: AK38610
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK38610%27 HTTP/1.1" 200 None
2026-03-30 11:56:11 [auto1.fr] INFO: Scrape type for AK38610: 0
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: SK24652
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: ZD66750
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: FS26317
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: AN67182
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: RB25104
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB25104%27 HTTP/1.1" 200 None
2026-03-30 11:56:11 [auto1.fr] INFO: Scrape type for RB25104: 0
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: GC58365
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: JN13323
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN13323%27 HTTP/1.1" 200 None
2026-03-30 11:56:11 [auto1.fr] INFO: Scrape type for JN13323: 0
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: PM06059
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: XK71446
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: LN63908
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: XF63220
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: EG51030
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: VK04958
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: LB25032
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: KU18790
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: CG65710
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: TF97321
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: YD68300
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: GM53873
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: LK56140
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK56140%27 HTTP/1.1" 200 None
2026-03-30 11:56:11 [auto1.fr] INFO: Scrape type for LK56140: 0
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: CY57197
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: YG03351
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: NC71697
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: CK37382
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: HX75346
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: KV53313
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: CL86896
2026-03-30 11:56:11 [auto1.fr] INFO: Found listing with ID: JJ98244
2026-03-30 11:56:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:15 [auto1.fr] INFO: Channel: 24h | Page: 91 | totalHits: 5668 | hits on page: 40
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: WZ16952
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: EV07055
2026-03-30 11:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV07055%27 HTTP/1.1" 200 None
2026-03-30 11:56:15 [auto1.fr] INFO: Scrape type for EV07055: 0
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: KX10882
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: XD75763
2026-03-30 11:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD75763%27 HTTP/1.1" 200 None
2026-03-30 11:56:15 [auto1.fr] INFO: Scrape type for XD75763: 0
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: HS75387
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: LF55274
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: PB88152
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: AD92116
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: FY39217
2026-03-30 11:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY39217%27 HTTP/1.1" 200 None
2026-03-30 11:56:15 [auto1.fr] INFO: Scrape type for FY39217: 0
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: SS42092
2026-03-30 11:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS42092%27 HTTP/1.1" 200 None
2026-03-30 11:56:15 [auto1.fr] INFO: Scrape type for SS42092: 0
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: PC92887
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: FE38558
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: AG04119
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: VX87591
2026-03-30 11:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX87591%27 HTTP/1.1" 200 None
2026-03-30 11:56:15 [auto1.fr] INFO: Scrape type for VX87591: 0
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: SV30155
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: HZ64883
2026-03-30 11:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ64883%27 HTTP/1.1" 200 None
2026-03-30 11:56:15 [auto1.fr] INFO: Scrape type for HZ64883: 0
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: WB41440
2026-03-30 11:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB41440%27 HTTP/1.1" 200 None
2026-03-30 11:56:15 [auto1.fr] INFO: Scrape type for WB41440: 0
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: MA12460
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: NE20699
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: AX53483
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: VC71107
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: MD00505
2026-03-30 11:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD00505%27 HTTP/1.1" 200 None
2026-03-30 11:56:15 [auto1.fr] INFO: Scrape type for MD00505: 0
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: FF28461
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: RN50760
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: HV57604
2026-03-30 11:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV57604%27 HTTP/1.1" 200 None
2026-03-30 11:56:15 [auto1.fr] INFO: Scrape type for HV57604: 0
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: PM19100
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: ZG75134
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: FK73792
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: HH41979
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: ST56941
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: LA84507
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: TL51104
2026-03-30 11:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL51104%27 HTTP/1.1" 200 None
2026-03-30 11:56:15 [auto1.fr] INFO: Scrape type for TL51104: 0
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: EB93167
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: AX41786
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: NS28706
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: ZN76963
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: JJ54898
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: HB07315
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: NY62204
2026-03-30 11:56:15 [auto1.fr] INFO: Found listing with ID: AS77345
2026-03-30 11:56:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:17 [auto1.fr] INFO: Channel: 24h | Page: 92 | totalHits: 5668 | hits on page: 40
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: WJ01379
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: UP01111
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UP01111%27 HTTP/1.1" 200 None
2026-03-30 11:56:17 [auto1.fr] INFO: Scrape type for UP01111: 0
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: VX72879
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: PJ49621
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: RY46240
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: ZE06169
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: XS01268
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS01268%27 HTTP/1.1" 200 None
2026-03-30 11:56:17 [auto1.fr] INFO: Scrape type for XS01268: 0
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: FL13370
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: SK35236
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: LP67639
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: ZF73790
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: RL88794
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: AX71622
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX71622%27 HTTP/1.1" 200 None
2026-03-30 11:56:17 [auto1.fr] INFO: Scrape type for AX71622: 0
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: UG46789
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG46789%27 HTTP/1.1" 200 None
2026-03-30 11:56:17 [auto1.fr] INFO: Scrape type for UG46789: 0
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: AZ11730
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ11730%27 HTTP/1.1" 200 None
2026-03-30 11:56:17 [auto1.fr] INFO: Scrape type for AZ11730: 0
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: WF21146
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: JD36177
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD36177%27 HTTP/1.1" 200 None
2026-03-30 11:56:17 [auto1.fr] INFO: Scrape type for JD36177: 0
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: TV78191
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: WY61697
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: FU50469
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU50469%27 HTTP/1.1" 200 None
2026-03-30 11:56:17 [auto1.fr] INFO: Scrape type for FU50469: 0
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: HV59700
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: TT03614
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: UD06601
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: UD67025
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: PR11684
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR11684%27 HTTP/1.1" 200 None
2026-03-30 11:56:17 [auto1.fr] INFO: Scrape type for PR11684: 0
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: AY73835
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: SE60139
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE60139%27 HTTP/1.1" 200 None
2026-03-30 11:56:17 [auto1.fr] INFO: Scrape type for SE60139: 0
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: RN08668
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: VS50564
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: UL73975
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: SJ38590
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ38590%27 HTTP/1.1" 200 None
2026-03-30 11:56:17 [auto1.fr] INFO: Scrape type for SJ38590: 0
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: LS24945
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: RB78829
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: YC59106
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC59106%27 HTTP/1.1" 200 None
2026-03-30 11:56:17 [auto1.fr] INFO: Scrape type for YC59106: 0
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: AW36161
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW36161%27 HTTP/1.1" 200 None
2026-03-30 11:56:17 [auto1.fr] INFO: Scrape type for AW36161: 0
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: LR83057
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: XA95461
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: EN28045
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: EE26786
2026-03-30 11:56:17 [auto1.fr] INFO: Found listing with ID: HX13782
2026-03-30 11:56:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:29 [auto1.fr] INFO: Channel: 24h | Page: 93 | totalHits: 5668 | hits on page: 40
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: FV44642
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV44642%27 HTTP/1.1" 200 None
2026-03-30 11:56:29 [auto1.fr] INFO: Scrape type for FV44642: 0
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: LT34083
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: UL75425
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: MG88051
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG88051%27 HTTP/1.1" 200 None
2026-03-30 11:56:29 [auto1.fr] INFO: Scrape type for MG88051: 0
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: AC41668
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: SU49595
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: MX43291
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: NW47205
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: KJ35871
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: RR97749
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR97749%27 HTTP/1.1" 200 None
2026-03-30 11:56:29 [auto1.fr] INFO: Scrape type for RR97749: 0
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: HP22528
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: KX83980
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX83980%27 HTTP/1.1" 200 None
2026-03-30 11:56:29 [auto1.fr] INFO: Scrape type for KX83980: 0
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: FK23336
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK23336%27 HTTP/1.1" 200 None
2026-03-30 11:56:29 [auto1.fr] INFO: Scrape type for FK23336: 0
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: EY12780
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: GG59474
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: VC93454
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: WF72416
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: KU35743
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU35743%27 HTTP/1.1" 200 None
2026-03-30 11:56:29 [auto1.fr] INFO: Scrape type for KU35743: 0
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: WX99023
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: LX87630
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: YS88817
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: YR82284
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR82284%27 HTTP/1.1" 200 None
2026-03-30 11:56:29 [auto1.fr] INFO: Scrape type for YR82284: 0
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: CF38557
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: KM62215
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: VN64616
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: UP19008
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: BW09951
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: AC05527
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC05527%27 HTTP/1.1" 200 None
2026-03-30 11:56:29 [auto1.fr] INFO: Scrape type for AC05527: 0
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: GM27790
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: NJ56198
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: DM99042
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM99042%27 HTTP/1.1" 200 None
2026-03-30 11:56:29 [auto1.fr] INFO: Scrape type for DM99042: 0
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: RK62587
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: FU20636
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU20636%27 HTTP/1.1" 200 None
2026-03-30 11:56:29 [auto1.fr] INFO: Scrape type for FU20636: 0
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: MD36539
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: GR08290
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: EK15899
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: JY07389
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: EF46973
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: KH91643
2026-03-30 11:56:29 [auto1.fr] INFO: Found listing with ID: EP75778
2026-03-30 11:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:33 [auto1.fr] INFO: Channel: 24h | Page: 94 | totalHits: 5670 | hits on page: 40
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: KH91643
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: EP75778
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: CY39121
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY39121%27 HTTP/1.1" 200 None
2026-03-30 11:56:33 [auto1.fr] INFO: Scrape type for CY39121: 0
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: MX94872
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX94872%27 HTTP/1.1" 200 None
2026-03-30 11:56:33 [auto1.fr] INFO: Scrape type for MX94872: 0
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: JE34470
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: FK98951
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: ME33575
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME33575%27 HTTP/1.1" 200 None
2026-03-30 11:56:33 [auto1.fr] INFO: Scrape type for ME33575: 0
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: UD05463
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: MD28531
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: EE55765
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE55765%27 HTTP/1.1" 200 None
2026-03-30 11:56:33 [auto1.fr] INFO: Scrape type for EE55765: 0
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: PP10113
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: PF14495
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: SW47860
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: BJ17608
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: XY60648
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: PK80705
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK80705%27 HTTP/1.1" 200 None
2026-03-30 11:56:33 [auto1.fr] INFO: Scrape type for PK80705: 0
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: DR84565
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: BD75746
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: YV50416
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: GH97582
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: WH53507
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: VD86421
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: LJ50312
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: BD67804
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD67804%27 HTTP/1.1" 200 None
2026-03-30 11:56:33 [auto1.fr] INFO: Scrape type for BD67804: 0
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: FD20720
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: UW89295
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW89295%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.fr] INFO: Scrape type for UW89295: 0
2026-03-30 11:56:34 [auto1.fr] INFO: Found listing with ID: ZW96440
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW96440%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.fr] INFO: Scrape type for ZW96440: 0
2026-03-30 11:56:34 [auto1.fr] INFO: Found listing with ID: ZY50775
2026-03-30 11:56:34 [auto1.fr] INFO: Found listing with ID: CT64778
2026-03-30 11:56:34 [auto1.fr] INFO: Found listing with ID: ML92572
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML92572%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.fr] INFO: Scrape type for ML92572: 0
2026-03-30 11:56:34 [auto1.fr] INFO: Found listing with ID: VS93501
2026-03-30 11:56:34 [auto1.fr] INFO: Found listing with ID: EG04001
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG04001%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.fr] INFO: Scrape type for EG04001: 0
2026-03-30 11:56:34 [auto1.fr] INFO: Found listing with ID: MT59073
2026-03-30 11:56:34 [auto1.fr] INFO: Found listing with ID: XL83385
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL83385%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.fr] INFO: Scrape type for XL83385: 0
2026-03-30 11:56:34 [auto1.fr] INFO: Found listing with ID: AF18569
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF18569%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.fr] INFO: Scrape type for AF18569: 0
2026-03-30 11:56:34 [auto1.fr] INFO: Found listing with ID: AR47486
2026-03-30 11:56:34 [auto1.fr] INFO: Found listing with ID: NE11748
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE11748%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.fr] INFO: Scrape type for NE11748: 0
2026-03-30 11:56:34 [auto1.fr] INFO: Found listing with ID: FK05830
2026-03-30 11:56:34 [auto1.fr] INFO: Found listing with ID: MU18843
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU18843%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.fr] INFO: Scrape type for MU18843: 0
2026-03-30 11:56:34 [auto1.fr] INFO: Found listing with ID: NZ88621
2026-03-30 11:56:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:42 [auto1.fr] INFO: Channel: 24h | Page: 95 | totalHits: 5670 | hits on page: 40
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: RG62052
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: TY32323
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY32323%27 HTTP/1.1" 200 None
2026-03-30 11:56:42 [auto1.fr] INFO: Scrape type for TY32323: 0
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: DC34167
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: KN77575
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: HL52009
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: MR35372
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR35372%27 HTTP/1.1" 200 None
2026-03-30 11:56:42 [auto1.fr] INFO: Scrape type for MR35372: 0
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: SD25089
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD25089%27 HTTP/1.1" 200 None
2026-03-30 11:56:42 [auto1.fr] INFO: Scrape type for SD25089: 0
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: CN26634
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN26634%27 HTTP/1.1" 200 None
2026-03-30 11:56:42 [auto1.fr] INFO: Scrape type for CN26634: 0
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: JY17204
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: HG97173
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: DB65012
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: GH89775
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GH89775%27 HTTP/1.1" 200 None
2026-03-30 11:56:42 [auto1.fr] INFO: Scrape type for GH89775: 0
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: VY25018
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: DE58184
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: WK76842
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: NH57081
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: ZX66674
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX66674%27 HTTP/1.1" 200 None
2026-03-30 11:56:42 [auto1.fr] INFO: Scrape type for ZX66674: 0
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: XD98684
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: KG18567
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: ZZ62826
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: BC93737
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: DH62205
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH62205%27 HTTP/1.1" 200 None
2026-03-30 11:56:42 [auto1.fr] INFO: Scrape type for DH62205: 0
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: LD25413
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: UR77796
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: NT08625
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: AA65542
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: UJ66470
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: ER64271
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER64271%27 HTTP/1.1" 200 None
2026-03-30 11:56:42 [auto1.fr] INFO: Scrape type for ER64271: 0
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: TP41770
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: XA15383
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: FY25332
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: SV56232
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: PW85948
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: CF32132
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: CA27736
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA27736%27 HTTP/1.1" 200 None
2026-03-30 11:56:42 [auto1.fr] INFO: Scrape type for CA27736: 0
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: AW32775
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: UK11725
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: DW22541
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: FT64075
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FT64075%27 HTTP/1.1" 200 None
2026-03-30 11:56:42 [auto1.fr] INFO: Scrape type for FT64075: 0
2026-03-30 11:56:42 [auto1.fr] INFO: Found listing with ID: SG55487
2026-03-30 11:56:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:57:03 [auto1.fr] INFO: Channel: 24h | Page: 96 | totalHits: 5670 | hits on page: 40
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: JM86086
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: WD58620
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: HL16549
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: GE93156
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: MB71350
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: JC47215
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: TT38529
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: EY32861
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: GV87304
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: GH15197
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: TR25442
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: JD86284
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: YZ97157
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: NJ87351
2026-03-30 11:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ87351%27 HTTP/1.1" 200 None
2026-03-30 11:57:03 [auto1.fr] INFO: Scrape type for NJ87351: 0
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: UW28110
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: NS63809
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: HS23568
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: MZ16726
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: UW84739
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: FS84170
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: PE35330
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: JA14962
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: GW21742
2026-03-30 11:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW21742%27 HTTP/1.1" 200 None
2026-03-30 11:57:03 [auto1.fr] INFO: Scrape type for GW21742: 0
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: MS74277
2026-03-30 11:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS74277%27 HTTP/1.1" 200 None
2026-03-30 11:57:03 [auto1.fr] INFO: Scrape type for MS74277: 0
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: AN48533
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: LJ61951
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: ZT58099
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: UM83805
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: MM07469
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: HP05689
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: KP65442
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: MT66619
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: WC30753
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: FL10414
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: NK54136
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: ER27932
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: MK17359
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: KP38186
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: VG25473
2026-03-30 11:57:03 [auto1.fr] INFO: Found listing with ID: HX93622
2026-03-30 11:57:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:57:05 [auto1.fr] INFO: Channel: 24h | Page: 97 | totalHits: 5671 | hits on page: 40
2026-03-30 11:57:05 [auto1.fr] INFO: Found listing with ID: HX93622
2026-03-30 11:57:05 [auto1.fr] INFO: Found listing with ID: CT92714
2026-03-30 11:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT92714%27 HTTP/1.1" 200 None
2026-03-30 11:57:05 [auto1.fr] INFO: Scrape type for CT92714: 0
2026-03-30 11:57:05 [auto1.fr] INFO: Found listing with ID: MS51100
2026-03-30 11:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS51100%27 HTTP/1.1" 200 None
2026-03-30 11:57:05 [auto1.fr] INFO: Scrape type for MS51100: 0
2026-03-30 11:57:05 [auto1.fr] INFO: Found listing with ID: KK83692
2026-03-30 11:57:05 [auto1.fr] INFO: Found listing with ID: JK75371
2026-03-30 11:57:05 [auto1.fr] INFO: Found listing with ID: RE03107
2026-03-30 11:57:05 [auto1.fr] INFO: Found listing with ID: VH60046
2026-03-30 11:57:05 [auto1.fr] INFO: Found listing with ID: XF87299
2026-03-30 11:57:05 [auto1.fr] INFO: Found listing with ID: YL83320
2026-03-30 11:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL83320%27 HTTP/1.1" 200 None
2026-03-30 11:57:05 [auto1.fr] INFO: Scrape type for YL83320: 0
2026-03-30 11:57:05 [auto1.fr] INFO: Found listing with ID: UD96168
2026-03-30 11:57:05 [auto1.fr] INFO: Found listing with ID: LN39968
2026-03-30 11:57:05 [auto1.fr] INFO: Found listing with ID: NA86883
2026-03-30 11:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NA86883%27 HTTP/1.1" 200 None
2026-03-30 11:57:05 [auto1.fr] INFO: Scrape type for NA86883: 2
2026-03-30 11:57:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5d90138-9b1e-5375-bb46-055662f820a0 with identifier: NA86883
2026-03-30 11:57:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5d90138-9b1e-5375-bb46-055662f820a0 with scrape type 2
2026-03-30 11:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5d90138-9b1e-5375-bb46-055662f820a0 with scrape type 2
2026-03-30 11:57:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b5d90138-9b1e-5375-bb46-055662f820a0, identifier: NA86883
2026-03-30 11:57:05 [scrapy.extensions.logstats] INFO: Crawled 343 pages (at 8 pages/min), scraped 222 items (at 0 items/min)
2026-03-30 11:57:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:57:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b5d90138-9b1e-5375-bb46-055662f820a0 with identifier: NA86883
2026-03-30 11:57:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b5d90138-9b1e-5375-bb46-055662f820a0 with identifier: NA86883
2026-03-30 11:57:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b5d90138-9b1e-5375-bb46-055662f820a0 with identifier: NA86883 to the API
2026-03-30 11:57:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:22:59Z',
'fuel_type': 'diesel',
'id': 'b5d90138-9b1e-5375-bb46-055662f820a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA86883',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Partner',
'odometer': 68477,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-31',
'seller_name': None,
'title': 'Peugeot Partner 1.5 Blue-HDi Premium L2',
'transmission': 'manual',
'trim': 'Premium L2',
'year': 2020}
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NA86883%27 HTTP/1.1" 200 None
2026-03-30 11:57:07 [auto1.fr] INFO: Saving data for NA86883: {'auction_closing_time': 1774884179.0, 'created_time': 1774598743.683109, 'last_price_update_time': 1774871827.692254}
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NA86883') HTTP/1.1" 204 0
2026-03-30 11:57:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: MD69842
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD69842%27 HTTP/1.1" 200 None
2026-03-30 11:57:07 [auto1.fr] INFO: Scrape type for MD69842: 0
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: CG81278
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: WN81957
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: NU29788
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU29788%27 HTTP/1.1" 200 None
2026-03-30 11:57:07 [auto1.fr] INFO: Scrape type for NU29788: 0
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: NE42933
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: FA81787
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA81787%27 HTTP/1.1" 200 None
2026-03-30 11:57:07 [auto1.fr] INFO: Scrape type for FA81787: 0
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: GG56079
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: EV64742
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: RT58444
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: HM64898
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: SK84670
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: CN65579
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: CT72019
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: MM30985
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: RR55482
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: UX73397
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: YR11120
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR11120%27 HTTP/1.1" 200 None
2026-03-30 11:57:07 [auto1.fr] INFO: Scrape type for YR11120: 0
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: HE44900
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: JD14959
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD14959%27 HTTP/1.1" 200 None
2026-03-30 11:57:07 [auto1.fr] INFO: Scrape type for JD14959: 0
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: BH00084
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH00084%27 HTTP/1.1" 200 None
2026-03-30 11:57:07 [auto1.fr] INFO: Scrape type for BH00084: 0
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: UY57064
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: ND09422
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: JK52044
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: TA04044
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: PS21697
2026-03-30 11:57:07 [auto1.fr] INFO: Found listing with ID: PS18899
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS18899%27 HTTP/1.1" 200 None
2026-03-30 11:57:08 [auto1.fr] INFO: Scrape type for PS18899: 0
2026-03-30 11:57:08 [auto1.fr] INFO: Found listing with ID: NH87335
2026-03-30 11:57:08 [auto1.fr] INFO: Found listing with ID: WX34918
2026-03-30 11:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:57:16 [auto1.fr] INFO: Channel: 24h | Page: 98 | totalHits: 5671 | hits on page: 40
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: YW51831
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: PS15455
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: YG70238
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG70238%27 HTTP/1.1" 200 None
2026-03-30 11:57:16 [auto1.fr] INFO: Scrape type for YG70238: 0
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: JD77184
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: KD23440
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD23440%27 HTTP/1.1" 200 None
2026-03-30 11:57:16 [auto1.fr] INFO: Scrape type for KD23440: 0
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: FY63151
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: TV80653
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: FA15271
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: YY03331
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: VK08918
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK08918%27 HTTP/1.1" 200 None
2026-03-30 11:57:16 [auto1.fr] INFO: Scrape type for VK08918: 0
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: WK69644
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WK69644%27 HTTP/1.1" 200 None
2026-03-30 11:57:16 [auto1.fr] INFO: Scrape type for WK69644: 0
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: MP49380
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: ZJ48056
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: WP36847
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP36847%27 HTTP/1.1" 200 None
2026-03-30 11:57:16 [auto1.fr] INFO: Scrape type for WP36847: 0
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: LW60229
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: ER13695
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: JU78053
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: ST25283
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST25283%27 HTTP/1.1" 200 None
2026-03-30 11:57:16 [auto1.fr] INFO: Scrape type for ST25283: 0
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: MN33134
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN33134%27 HTTP/1.1" 200 None
2026-03-30 11:57:16 [auto1.fr] INFO: Scrape type for MN33134: 0
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: TZ71973
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: RD39200
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: PX94335
2026-03-30 11:57:16 [auto1.fr] INFO: Found listing with ID: WW90706
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW90706%27 HTTP/1.1" 200 None
2026-03-30 11:57:16 [auto1.fr] INFO: Scrape type for WW90706: 2
2026-03-30 11:57:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a4ac27a-813c-5ecd-bf7a-743c2c726bed with identifier: WW90706
2026-03-30 11:57:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a4ac27a-813c-5ecd-bf7a-743c2c726bed with scrape type 2
2026-03-30 11:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a4ac27a-813c-5ecd-bf7a-743c2c726bed with scrape type 2
2026-03-30 11:57:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2a4ac27a-813c-5ecd-bf7a-743c2c726bed, identifier: WW90706
2026-03-30 11:57:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2a4ac27a-813c-5ecd-bf7a-743c2c726bed with identifier: WW90706
2026-03-30 11:57:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2a4ac27a-813c-5ecd-bf7a-743c2c726bed with identifier: WW90706
2026-03-30 11:57:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2a4ac27a-813c-5ecd-bf7a-743c2c726bed with identifier: WW90706 to the API
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 280,
'expiration_date': '2026-03-30T15:40:43Z',
'fuel_type': 'hybrid',
'id': '2a4ac27a-813c-5ecd-bf7a-743c2c726bed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW90706',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Tonale',
'odometer': 70051,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-12',
'seller_name': None,
'title': 'Alfa Romeo Tonale 1.3 Plug-in Hybrid Veloce AWD',
'transmission': 'automatic',
'trim': 'Veloce AWD',
'year': 2023}
2026-03-30 11:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW90706%27 HTTP/1.1" 200 None
2026-03-30 11:57:17 [auto1.fr] INFO: Saving data for WW90706: {'auction_closing_time': 1774885243.0, 'created_time': 1774598723.657797, 'last_price_update_time': 1774871837.837486}
2026-03-30 11:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WW90706') HTTP/1.1" 204 0
2026-03-30 11:57:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:57:17 [auto1.fr] INFO: Found listing with ID: YP81019
2026-03-30 11:57:17 [auto1.fr] INFO: Found listing with ID: PJ58780
2026-03-30 11:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ58780%27 HTTP/1.1" 200 None
2026-03-30 11:57:17 [auto1.fr] INFO: Scrape type for PJ58780: 0
2026-03-30 11:57:17 [auto1.fr] INFO: Found listing with ID: EF38669
2026-03-30 11:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF38669%27 HTTP/1.1" 200 None
2026-03-30 11:57:17 [auto1.fr] INFO: Scrape type for EF38669: 0
2026-03-30 11:57:17 [auto1.fr] INFO: Found listing with ID: XP39781
2026-03-30 11:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP39781%27 HTTP/1.1" 200 None
2026-03-30 11:57:18 [auto1.fr] INFO: Scrape type for XP39781: 0
2026-03-30 11:57:18 [auto1.fr] INFO: Found listing with ID: BM88611
2026-03-30 11:57:18 [auto1.fr] INFO: Found listing with ID: VF38659
2026-03-30 11:57:18 [auto1.fr] INFO: Found listing with ID: UJ08020
2026-03-30 11:57:18 [auto1.fr] INFO: Found listing with ID: KL85301
2026-03-30 11:57:18 [auto1.fr] INFO: Found listing with ID: DM90581
2026-03-30 11:57:18 [auto1.fr] INFO: Found listing with ID: HY35486
2026-03-30 11:57:18 [auto1.fr] INFO: Found listing with ID: UV57376
2026-03-30 11:57:18 [auto1.fr] INFO: Found listing with ID: AN13848
2026-03-30 11:57:18 [auto1.fr] INFO: Found listing with ID: NP93017
2026-03-30 11:57:18 [auto1.fr] INFO: Found listing with ID: GV82833
2026-03-30 11:57:18 [auto1.fr] INFO: Found listing with ID: VJ57370
2026-03-30 11:57:18 [auto1.fr] INFO: Found listing with ID: YH48214
2026-03-30 11:57:18 [auto1.fr] INFO: Found listing with ID: EW26856
2026-03-30 11:57:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:57:35 [auto1.fr] INFO: Channel: 24h | Page: 99 | totalHits: 5673 | hits on page: 40
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: YH48214
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: EW26856
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: KU04906
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: MZ70913
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: SL78382
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: MP87348
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP87348%27 HTTP/1.1" 200 None
2026-03-30 11:57:35 [auto1.fr] INFO: Scrape type for MP87348: 0
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: DU07698
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: ND01459
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: NK65049
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: YJ08145
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: VH93695
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH93695%27 HTTP/1.1" 200 None
2026-03-30 11:57:35 [auto1.fr] INFO: Scrape type for VH93695: 0
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: MN69487
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN69487%27 HTTP/1.1" 200 None
2026-03-30 11:57:35 [auto1.fr] INFO: Scrape type for MN69487: 0
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: LL77834
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: ZW72190
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: UZ33747
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ33747%27 HTTP/1.1" 200 None
2026-03-30 11:57:35 [auto1.fr] INFO: Scrape type for UZ33747: 0
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: YZ02897
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: BA82205
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: UC74566
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: VP25340
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: TL16727
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: MD88959
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD88959%27 HTTP/1.1" 200 None
2026-03-30 11:57:35 [auto1.fr] INFO: Scrape type for MD88959: 0
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: WY34434
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: KF11436
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: CN83275
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN83275%27 HTTP/1.1" 200 None
2026-03-30 11:57:35 [auto1.fr] INFO: Scrape type for CN83275: 0
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: TX99737
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX99737%27 HTTP/1.1" 200 None
2026-03-30 11:57:35 [auto1.fr] INFO: Scrape type for TX99737: 0
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: MD12613
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: CY84423
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: SU40545
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: ZK50786
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: YC53751
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: CR71429
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: DH20773
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: YT51945
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT51945%27 HTTP/1.1" 200 None
2026-03-30 11:57:35 [auto1.fr] INFO: Scrape type for YT51945: 0
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: AH72783
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH72783%27 HTTP/1.1" 200 None
2026-03-30 11:57:35 [auto1.fr] INFO: Scrape type for AH72783: 0
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: HP09447
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: CC90261
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: FD08620
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD08620%27 HTTP/1.1" 200 None
2026-03-30 11:57:35 [auto1.fr] INFO: Scrape type for FD08620: 0
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: LP46372
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: TJ94582
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ94582%27 HTTP/1.1" 200 None
2026-03-30 11:57:35 [auto1.fr] INFO: Scrape type for TJ94582: 0
2026-03-30 11:57:35 [auto1.fr] INFO: Found listing with ID: UA32984
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA32984%27 HTTP/1.1" 200 None
2026-03-30 11:57:35 [auto1.fr] INFO: Scrape type for UA32984: 0
2026-03-30 11:57:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:58:05 [scrapy.extensions.logstats] INFO: Crawled 345 pages (at 2 pages/min), scraped 224 items (at 2 items/min)
2026-03-30 11:58:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:59:05 [scrapy.extensions.logstats] INFO: Crawled 345 pages (at 0 pages/min), scraped 224 items (at 0 items/min)
2026-03-30 11:59:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 11:59:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.954(s), this was the 1st time calling it.
2026-03-30 11:59:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.734351687457017 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:59:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:05 [auto1.fr] INFO: Channel: 24h | Page: 100 | totalHits: 5680 | hits on page: 40
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: AH72783
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH72783%27 HTTP/1.1" 200 None
2026-03-30 12:00:05 [auto1.fr] INFO: Scrape type for AH72783: 0
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: HP09447
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: CC90261
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: FD08620
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD08620%27 HTTP/1.1" 200 None
2026-03-30 12:00:05 [auto1.fr] INFO: Scrape type for FD08620: 0
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: LP46372
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: TJ94582
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ94582%27 HTTP/1.1" 200 None
2026-03-30 12:00:05 [auto1.fr] INFO: Scrape type for TJ94582: 0
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: UA32984
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA32984%27 HTTP/1.1" 200 None
2026-03-30 12:00:05 [auto1.fr] INFO: Scrape type for UA32984: 0
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: WU85664
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: EX17744
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: EC17210
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: VF47862
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: UY88811
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY88811%27 HTTP/1.1" 200 None
2026-03-30 12:00:05 [auto1.fr] INFO: Scrape type for UY88811: 0
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: EJ91890
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: UY33007
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: KD06239
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: LH33113
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: PZ31154
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: PN67245
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: TV07997
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV07997%27 HTTP/1.1" 200 None
2026-03-30 12:00:05 [auto1.fr] INFO: Scrape type for TV07997: 0
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: MN66061
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: FL00176
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: HT93217
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT93217%27 HTTP/1.1" 200 None
2026-03-30 12:00:05 [auto1.fr] INFO: Scrape type for HT93217: 0
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: GT16530
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: MM76244
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: HJ29503
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HJ29503%27 HTTP/1.1" 200 None
2026-03-30 12:00:05 [auto1.fr] INFO: Scrape type for HJ29503: 0
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: WK41306
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: EL79305
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: AK12827
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: PJ15466
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: ZN42149
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN42149%27 HTTP/1.1" 200 None
2026-03-30 12:00:05 [auto1.fr] INFO: Scrape type for ZN42149: 2
2026-03-30 12:00:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: affa21c6-44d3-5474-ae51-8ce61ac0c323 with identifier: ZN42149
2026-03-30 12:00:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item affa21c6-44d3-5474-ae51-8ce61ac0c323 with scrape type 2
2026-03-30 12:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item affa21c6-44d3-5474-ae51-8ce61ac0c323 with scrape type 2
2026-03-30 12:00:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: affa21c6-44d3-5474-ae51-8ce61ac0c323, identifier: ZN42149
2026-03-30 12:00:05 [scrapy.extensions.logstats] INFO: Crawled 346 pages (at 1 pages/min), scraped 224 items (at 0 items/min)
2026-03-30 12:00:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:00:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: affa21c6-44d3-5474-ae51-8ce61ac0c323 with identifier: ZN42149
2026-03-30 12:00:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: affa21c6-44d3-5474-ae51-8ce61ac0c323 with identifier: ZN42149
2026-03-30 12:00:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: affa21c6-44d3-5474-ae51-8ce61ac0c323 with identifier: ZN42149 to the API
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:54:31Z',
'fuel_type': 'diesel',
'id': 'affa21c6-44d3-5474-ae51-8ce61ac0c323',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN42149',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 167779,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-30',
'seller_name': None,
'title': 'BMW X5 xDrive 30d',
'transmission': 'automatic',
'trim': '',
'year': 2010}
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN42149%27 HTTP/1.1" 200 None
2026-03-30 12:00:06 [auto1.fr] INFO: Saving data for ZN42149: {'auction_closing_time': 1774886071.0, 'created_time': 1773865008.328777, 'last_price_update_time': 1774872006.760272}
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZN42149') HTTP/1.1" 204 0
2026-03-30 12:00:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:06 [auto1.fr] INFO: Found listing with ID: VS72948
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS72948%27 HTTP/1.1" 200 None
2026-03-30 12:00:06 [auto1.fr] INFO: Scrape type for VS72948: 0
2026-03-30 12:00:06 [auto1.fr] INFO: Found listing with ID: MB37310
2026-03-30 12:00:06 [auto1.fr] INFO: Found listing with ID: TE52661
2026-03-30 12:00:06 [auto1.fr] INFO: Found listing with ID: XR89860
2026-03-30 12:00:06 [auto1.fr] INFO: Found listing with ID: RT99319
2026-03-30 12:00:06 [auto1.fr] INFO: Found listing with ID: RP10515
2026-03-30 12:00:06 [auto1.fr] INFO: Found listing with ID: GG20575
2026-03-30 12:00:06 [auto1.fr] INFO: Found listing with ID: LN63849
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN63849%27 HTTP/1.1" 200 None
2026-03-30 12:00:06 [auto1.fr] INFO: Scrape type for LN63849: 0
2026-03-30 12:00:06 [auto1.fr] INFO: Found listing with ID: PU97968
2026-03-30 12:00:06 [auto1.fr] INFO: Found listing with ID: VN21149
2026-03-30 12:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:08 [auto1.fr] INFO: Channel: 24h | Page: 101 | totalHits: 5680 | hits on page: 40
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: MV90750
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: MM28958
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: BR00420
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: SW63127
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: SX78543
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX78543%27 HTTP/1.1" 200 None
2026-03-30 12:00:08 [auto1.fr] INFO: Scrape type for SX78543: 0
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: WY78026
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: ZS46246
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: ZK87358
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: EG61465
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: UB38513
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB38513%27 HTTP/1.1" 200 None
2026-03-30 12:00:08 [auto1.fr] INFO: Scrape type for UB38513: 0
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: RF55114
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: RE22137
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE22137%27 HTTP/1.1" 200 None
2026-03-30 12:00:08 [auto1.fr] INFO: Scrape type for RE22137: 0
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: UH93252
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UH93252%27 HTTP/1.1" 200 None
2026-03-30 12:00:08 [auto1.fr] INFO: Scrape type for UH93252: 0
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: TH45766
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: DD29235
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: KU97686
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU97686%27 HTTP/1.1" 200 None
2026-03-30 12:00:08 [auto1.fr] INFO: Scrape type for KU97686: 0
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: AP43967
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: NH46093
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH46093%27 HTTP/1.1" 200 None
2026-03-30 12:00:08 [auto1.fr] INFO: Scrape type for NH46093: 0
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: MD10490
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: VE88379
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE88379%27 HTTP/1.1" 200 None
2026-03-30 12:00:08 [auto1.fr] INFO: Scrape type for VE88379: 0
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: HG31065
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG31065%27 HTTP/1.1" 200 None
2026-03-30 12:00:08 [auto1.fr] INFO: Scrape type for HG31065: 0
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: SF42406
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF42406%27 HTTP/1.1" 200 None
2026-03-30 12:00:08 [auto1.fr] INFO: Scrape type for SF42406: 0
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: DN97834
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: RM88358
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: DF10648
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: PS61958
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: AR61190
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: BR83568
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: SB20232
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: XR57689
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR57689%27 HTTP/1.1" 200 None
2026-03-30 12:00:08 [auto1.fr] INFO: Scrape type for XR57689: 0
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: RD43481
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: MU27491
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: XN91695
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN91695%27 HTTP/1.1" 200 None
2026-03-30 12:00:08 [auto1.fr] INFO: Scrape type for XN91695: 0
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: FW43931
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: EH31611
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: ZD97088
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: UC74553
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC74553%27 HTTP/1.1" 200 None
2026-03-30 12:00:08 [auto1.fr] INFO: Scrape type for UC74553: 0
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: FD71180
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD71180%27 HTTP/1.1" 200 None
2026-03-30 12:00:08 [auto1.fr] INFO: Scrape type for FD71180: 0
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: FJ70435
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: AT38634
2026-03-30 12:00:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:11 [auto1.fr] INFO: Channel: 24h | Page: 102 | totalHits: 5680 | hits on page: 40
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: RR91424
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: PP44848
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PP44848%27 HTTP/1.1" 200 None
2026-03-30 12:00:11 [auto1.fr] INFO: Scrape type for PP44848: 0
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: FU95990
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: DA14290
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: NM65342
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: MZ17908
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: EP19309
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: ZB34276
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: BR41818
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: MY09161
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: TF94753
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: AC91705
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: GF86255
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: UX16987
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: HH30569
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH30569%27 HTTP/1.1" 200 None
2026-03-30 12:00:11 [auto1.fr] INFO: Scrape type for HH30569: 0
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: DT96128
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DT96128%27 HTTP/1.1" 200 None
2026-03-30 12:00:11 [auto1.fr] INFO: Scrape type for DT96128: 0
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: GJ13192
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: ED04570
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: SR29191
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: TU91733
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: ML23604
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: ST53729
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST53729%27 HTTP/1.1" 200 None
2026-03-30 12:00:11 [auto1.fr] INFO: Scrape type for ST53729: 0
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: ZG38272
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: KL75715
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: TE52859
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE52859%27 HTTP/1.1" 200 None
2026-03-30 12:00:11 [auto1.fr] INFO: Scrape type for TE52859: 0
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: DK36476
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: JM47133
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: VZ99500
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: XE12158
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: CL80852
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: ZY73935
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: FX76531
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: YV06493
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: UV56831
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: JY75647
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: DL67560
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: RF49940
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: LK87093
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: UU85427
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UU85427%27 HTTP/1.1" 200 None
2026-03-30 12:00:11 [auto1.fr] INFO: Scrape type for UU85427: 0
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: TY38326
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY38326%27 HTTP/1.1" 200 None
2026-03-30 12:00:11 [auto1.fr] INFO: Scrape type for TY38326: 0
2026-03-30 12:00:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:19 [auto1.fr] INFO: Channel: 24h | Page: 103 | totalHits: 5680 | hits on page: 40
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: RW71357
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: RB49673
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: BF87888
2026-03-30 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BF87888%27 HTTP/1.1" 200 None
2026-03-30 12:00:19 [auto1.fr] INFO: Scrape type for BF87888: 0
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: NF91897
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: MV08172
2026-03-30 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV08172%27 HTTP/1.1" 200 None
2026-03-30 12:00:19 [auto1.fr] INFO: Scrape type for MV08172: 0
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: YG57350
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: MR80425
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: LV77548
2026-03-30 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LV77548%27 HTTP/1.1" 200 None
2026-03-30 12:00:19 [auto1.fr] INFO: Scrape type for LV77548: 0
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: JX19943
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: EF38661
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: NH71773
2026-03-30 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH71773%27 HTTP/1.1" 200 None
2026-03-30 12:00:19 [auto1.fr] INFO: Scrape type for NH71773: 0
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: RR34220
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: SA59848
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: MR98478
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: UB23071
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: NV19792
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: EC31783
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: YP70210
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: RS33874
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: FP36699
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: WD39864
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: FH19004
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: AP24088
2026-03-30 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AP24088%27 HTTP/1.1" 200 None
2026-03-30 12:00:19 [auto1.fr] INFO: Scrape type for AP24088: 0
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: MP85730
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: DJ00737
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: YZ16711
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: BE71739
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: NX59215
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: LN87144
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: FC74849
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: NC49171
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: AZ58184
2026-03-30 12:00:19 [auto1.fr] INFO: Found listing with ID: BH26535
2026-03-30 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH26535%27 HTTP/1.1" 200 None
2026-03-30 12:00:20 [auto1.fr] INFO: Scrape type for BH26535: 0
2026-03-30 12:00:20 [auto1.fr] INFO: Found listing with ID: VM86019
2026-03-30 12:00:20 [auto1.fr] INFO: Found listing with ID: ZH59438
2026-03-30 12:00:20 [auto1.fr] INFO: Found listing with ID: AM51224
2026-03-30 12:00:20 [auto1.fr] INFO: Found listing with ID: SX54041
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX54041%27 HTTP/1.1" 200 None
2026-03-30 12:00:20 [auto1.fr] INFO: Scrape type for SX54041: 0
2026-03-30 12:00:20 [auto1.fr] INFO: Found listing with ID: FB21103
2026-03-30 12:00:20 [auto1.fr] INFO: Found listing with ID: MH39363
2026-03-30 12:00:20 [auto1.fr] INFO: Found listing with ID: HZ90961
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ90961%27 HTTP/1.1" 200 None
2026-03-30 12:00:20 [auto1.fr] INFO: Scrape type for HZ90961: 0
2026-03-30 12:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:28 [auto1.fr] INFO: Channel: 24h | Page: 104 | totalHits: 5680 | hits on page: 40
2026-03-30 12:00:28 [auto1.fr] INFO: Found listing with ID: UM01118
2026-03-30 12:00:28 [auto1.fr] INFO: Found listing with ID: DC06822
2026-03-30 12:00:28 [auto1.fr] INFO: Found listing with ID: XE08250
2026-03-30 12:00:28 [auto1.fr] INFO: Found listing with ID: AV33142
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV33142%27 HTTP/1.1" 200 None
2026-03-30 12:00:28 [auto1.fr] INFO: Scrape type for AV33142: 0
2026-03-30 12:00:28 [auto1.fr] INFO: Found listing with ID: VH41528
2026-03-30 12:00:28 [auto1.fr] INFO: Found listing with ID: EU34225
2026-03-30 12:00:28 [auto1.fr] INFO: Found listing with ID: YN96832
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YN96832%27 HTTP/1.1" 200 None
2026-03-30 12:00:28 [auto1.fr] INFO: Scrape type for YN96832: 0
2026-03-30 12:00:28 [auto1.fr] INFO: Found listing with ID: ZK94521
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK94521%27 HTTP/1.1" 200 None
2026-03-30 12:00:28 [auto1.fr] INFO: Scrape type for ZK94521: 0
2026-03-30 12:00:28 [auto1.fr] INFO: Found listing with ID: RU45955
2026-03-30 12:00:28 [auto1.fr] INFO: Found listing with ID: VU02387
2026-03-30 12:00:28 [auto1.fr] INFO: Found listing with ID: CL54463
2026-03-30 12:00:28 [auto1.fr] INFO: Found listing with ID: HG60579
2026-03-30 12:00:28 [auto1.fr] INFO: Found listing with ID: XD50705
2026-03-30 12:00:28 [auto1.fr] INFO: Found listing with ID: FD55779
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD55779%27 HTTP/1.1" 200 None
2026-03-30 12:00:28 [auto1.fr] INFO: Scrape type for FD55779: 0
2026-03-30 12:00:28 [auto1.fr] INFO: Found listing with ID: XT11394
2026-03-30 12:00:28 [auto1.fr] INFO: Found listing with ID: GV95018
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV95018%27 HTTP/1.1" 200 None
2026-03-30 12:00:29 [auto1.fr] INFO: Scrape type for GV95018: 0
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: CZ93131
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: ND13207
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: SG33724
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: DT21905
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DT21905%27 HTTP/1.1" 200 None
2026-03-30 12:00:29 [auto1.fr] INFO: Scrape type for DT21905: 0
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: MF77875
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: ZK84103
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: MP66959
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP66959%27 HTTP/1.1" 200 None
2026-03-30 12:00:29 [auto1.fr] INFO: Scrape type for MP66959: 0
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: BX42794
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: KR84190
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR84190%27 HTTP/1.1" 200 None
2026-03-30 12:00:29 [auto1.fr] INFO: Scrape type for KR84190: 0
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: CZ69538
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: TG94455
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: PR03169
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: GS07169
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: VM69167
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: CD17301
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD17301%27 HTTP/1.1" 200 None
2026-03-30 12:00:29 [auto1.fr] INFO: Scrape type for CD17301: 0
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: UM62874
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: NP85383
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: ZJ32600
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: FR70440
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: MM41559
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: FH59874
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: FD56672
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD56672%27 HTTP/1.1" 200 None
2026-03-30 12:00:29 [auto1.fr] INFO: Scrape type for FD56672: 0
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: TG24288
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: DK98853
2026-03-30 12:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:31 [auto1.fr] INFO: Channel: 24h | Page: 105 | totalHits: 5682 | hits on page: 40
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: TG24288
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: DK98853
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: TL12646
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: HG30830
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: CB86002
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: WG61508
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: KP69779
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP69779%27 HTTP/1.1" 200 None
2026-03-30 12:00:31 [auto1.fr] INFO: Scrape type for KP69779: 0
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: WC20404
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: RB44910
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: JU72656
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: AE63144
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: MZ90683
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: BS06698
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: UC18078
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: EM50741
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: KE50703
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KE50703%27 HTTP/1.1" 200 None
2026-03-30 12:00:31 [auto1.fr] INFO: Scrape type for KE50703: 0
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: PY61328
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: FZ00281
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: AV52743
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV52743%27 HTTP/1.1" 200 None
2026-03-30 12:00:31 [auto1.fr] INFO: Scrape type for AV52743: 0
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: LF93998
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF93998%27 HTTP/1.1" 200 None
2026-03-30 12:00:31 [auto1.fr] INFO: Scrape type for LF93998: 0
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: PJ63799
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: LA56862
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: CN55587
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: DS92577
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS92577%27 HTTP/1.1" 200 None
2026-03-30 12:00:31 [auto1.fr] INFO: Scrape type for DS92577: 0
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: KL33528
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: TB74385
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: RZ47364
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: TD18216
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: XW27990
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: BK15343
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK15343%27 HTTP/1.1" 200 None
2026-03-30 12:00:31 [auto1.fr] INFO: Scrape type for BK15343: 0
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: SJ55712
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: XR69838
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: KP36638
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: MA20001
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: XB39762
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB39762%27 HTTP/1.1" 200 None
2026-03-30 12:00:31 [auto1.fr] INFO: Scrape type for XB39762: 0
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: CP68877
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: HH48704
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH48704%27 HTTP/1.1" 200 None
2026-03-30 12:00:31 [auto1.fr] INFO: Scrape type for HH48704: 0
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: YB96343
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: ZG36173
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: GS55232
2026-03-30 12:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:38 [auto1.fr] INFO: Channel: 24h | Page: 106 | totalHits: 5683 | hits on page: 40
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: GS55232
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: EC35846
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC35846%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.fr] INFO: Scrape type for EC35846: 0
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: SS26228
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: HL22941
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL22941%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.fr] INFO: Scrape type for HL22941: 0
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: JA02670
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: RV29196
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: BD15498
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: PL96351
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: PE72245
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: HK47615
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: KH88430
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: DY88686
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: AF99064
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: YS52687
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: LS45360
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: BN62096
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: AE85756
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: BS70158
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: RG31547
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: AG85717
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: BH35269
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH35269%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.fr] INFO: Scrape type for BH35269: 0
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: DS58335
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS58335%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.fr] INFO: Scrape type for DS58335: 0
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: VG11419
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG11419%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.fr] INFO: Scrape type for VG11419: 0
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: FB36187
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: AF27253
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: WR77644
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR77644%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.fr] INFO: Scrape type for WR77644: 0
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: XX05016
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: SF08210
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF08210%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.fr] INFO: Scrape type for SF08210: 0
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: PG76188
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: MV13696
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV13696%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.fr] INFO: Scrape type for MV13696: 0
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: TX20850
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX20850%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.fr] INFO: Scrape type for TX20850: 0
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: GN72204
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: HB88268
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: RR98715
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: ML29204
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML29204%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.fr] INFO: Scrape type for ML29204: 0
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: YS84605
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS84605%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.fr] INFO: Scrape type for YS84605: 0
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: TR94670
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: RZ43302
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: GW15397
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: NX44773
2026-03-30 12:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:05 [scrapy.extensions.logstats] INFO: Crawled 352 pages (at 6 pages/min), scraped 225 items (at 1 items/min)
2026-03-30 12:01:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:10 [auto1.fr] INFO: Channel: 24h | Page: 107 | totalHits: 5685 | hits on page: 40
2026-03-30 12:01:10 [auto1.fr] INFO: Found listing with ID: GW15397
2026-03-30 12:01:10 [auto1.fr] INFO: Found listing with ID: NX44773
2026-03-30 12:01:10 [auto1.fr] INFO: Found listing with ID: HT34496
2026-03-30 12:01:10 [auto1.fr] INFO: Found listing with ID: MB04765
2026-03-30 12:01:10 [auto1.fr] INFO: Found listing with ID: SX50304
2026-03-30 12:01:10 [auto1.fr] INFO: Found listing with ID: GW47315
2026-03-30 12:01:10 [auto1.fr] INFO: Found listing with ID: XS17493
2026-03-30 12:01:10 [auto1.fr] INFO: Found listing with ID: JN19759
2026-03-30 12:01:10 [auto1.fr] INFO: Found listing with ID: SJ29154
2026-03-30 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ29154%27 HTTP/1.1" 200 None
2026-03-30 12:01:11 [auto1.fr] INFO: Scrape type for SJ29154: 0
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: ZX89558
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: AV67556
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: GX34616
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GX34616%27 HTTP/1.1" 200 None
2026-03-30 12:01:11 [auto1.fr] INFO: Scrape type for GX34616: 0
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: RV30465
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV30465%27 HTTP/1.1" 200 None
2026-03-30 12:01:11 [auto1.fr] INFO: Scrape type for RV30465: 0
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: MY01215
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: XX41832
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: AV25502
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: WD97133
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: DS91774
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: JS99240
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JS99240%27 HTTP/1.1" 200 None
2026-03-30 12:01:11 [auto1.fr] INFO: Scrape type for JS99240: 0
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: BZ31250
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: XB64542
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB64542%27 HTTP/1.1" 200 None
2026-03-30 12:01:11 [auto1.fr] INFO: Scrape type for XB64542: 0
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: RR43233
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: EK08902
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: AC61454
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC61454%27 HTTP/1.1" 200 None
2026-03-30 12:01:11 [auto1.fr] INFO: Scrape type for AC61454: 0
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: JV51312
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV51312%27 HTTP/1.1" 200 None
2026-03-30 12:01:11 [auto1.fr] INFO: Scrape type for JV51312: 0
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: WP15494
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: NA88907
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: YZ38650
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: RZ84099
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ84099%27 HTTP/1.1" 200 None
2026-03-30 12:01:11 [auto1.fr] INFO: Scrape type for RZ84099: 0
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: MZ51504
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: FM33156
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM33156%27 HTTP/1.1" 200 None
2026-03-30 12:01:11 [auto1.fr] INFO: Scrape type for FM33156: 0
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: ND52454
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: SH68071
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SH68071%27 HTTP/1.1" 200 None
2026-03-30 12:01:11 [auto1.fr] INFO: Scrape type for SH68071: 0
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: GF28469
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF28469%27 HTTP/1.1" 200 None
2026-03-30 12:01:11 [auto1.fr] INFO: Scrape type for GF28469: 0
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: EX34772
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: GL86382
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: MP83150
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: VV47499
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: TC98272
2026-03-30 12:01:11 [auto1.fr] INFO: Found listing with ID: ZC11920
2026-03-30 12:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:12 [auto1.fr] INFO: Channel: 24h | Page: 108 | totalHits: 5685 | hits on page: 40
2026-03-30 12:01:12 [auto1.fr] INFO: Found listing with ID: DF39125
2026-03-30 12:01:12 [auto1.fr] INFO: Found listing with ID: HZ94791
2026-03-30 12:01:12 [auto1.fr] INFO: Found listing with ID: PC67376
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PC67376%27 HTTP/1.1" 200 None
2026-03-30 12:01:12 [auto1.fr] INFO: Scrape type for PC67376: 0
2026-03-30 12:01:12 [auto1.fr] INFO: Found listing with ID: AE53332
2026-03-30 12:01:12 [auto1.fr] INFO: Found listing with ID: MH81805
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH81805%27 HTTP/1.1" 200 None
2026-03-30 12:01:12 [auto1.fr] INFO: Scrape type for MH81805: 0
2026-03-30 12:01:12 [auto1.fr] INFO: Found listing with ID: JK72589
2026-03-30 12:01:12 [auto1.fr] INFO: Found listing with ID: JT52882
2026-03-30 12:01:12 [auto1.fr] INFO: Found listing with ID: SJ06843
2026-03-30 12:01:12 [auto1.fr] INFO: Found listing with ID: HV60888
2026-03-30 12:01:12 [auto1.fr] INFO: Found listing with ID: TS81790
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TS81790%27 HTTP/1.1" 200 None
2026-03-30 12:01:12 [auto1.fr] INFO: Scrape type for TS81790: 0
2026-03-30 12:01:12 [auto1.fr] INFO: Found listing with ID: UM47720
2026-03-30 12:01:12 [auto1.fr] INFO: Found listing with ID: XC92409
2026-03-30 12:01:12 [auto1.fr] INFO: Found listing with ID: PY05683
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY05683%27 HTTP/1.1" 200 None
2026-03-30 12:01:12 [auto1.fr] INFO: Scrape type for PY05683: 0
2026-03-30 12:01:12 [auto1.fr] INFO: Found listing with ID: SL63726
2026-03-30 12:01:12 [auto1.fr] INFO: Found listing with ID: YR85654
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR85654%27 HTTP/1.1" 200 None
2026-03-30 12:01:12 [auto1.fr] INFO: Scrape type for YR85654: 2
2026-03-30 12:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 812bc6b3-9320-54b6-879e-8c4984fe7bb8 with identifier: YR85654
2026-03-30 12:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 812bc6b3-9320-54b6-879e-8c4984fe7bb8 with scrape type 2
2026-03-30 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 812bc6b3-9320-54b6-879e-8c4984fe7bb8 with scrape type 2
2026-03-30 12:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 812bc6b3-9320-54b6-879e-8c4984fe7bb8, identifier: YR85654
2026-03-30 12:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 812bc6b3-9320-54b6-879e-8c4984fe7bb8 with identifier: YR85654
2026-03-30 12:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 812bc6b3-9320-54b6-879e-8c4984fe7bb8 with identifier: YR85654
2026-03-30 12:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 812bc6b3-9320-54b6-879e-8c4984fe7bb8 with identifier: YR85654 to the API
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 91,
'expiration_date': '2026-03-30T15:24:46Z',
'fuel_type': 'petrol',
'id': '812bc6b3-9320-54b6-879e-8c4984fe7bb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR85654',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 57659,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-21',
'seller_name': None,
'title': 'Renault Clio 1.0 TCe Evolution',
'transmission': 'manual',
'trim': 'Evolution',
'year': 2022}
2026-03-30 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR85654%27 HTTP/1.1" 200 None
2026-03-30 12:01:13 [auto1.fr] INFO: Saving data for YR85654: {'auction_closing_time': 1774884286.0, 'created_time': 1773918834.079125, 'last_price_update_time': 1774872073.099153}
2026-03-30 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YR85654') HTTP/1.1" 204 0
2026-03-30 12:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: PU86663
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: FM11789
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: HB48660
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: UG12722
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: RG19413
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: MS29276
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: VF03243
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: LB50656
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: GZ88251
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: TS55065
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: RE74240
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: WL36176
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: HU57774
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: JZ87275
2026-03-30 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ87275%27 HTTP/1.1" 200 None
2026-03-30 12:01:13 [auto1.fr] INFO: Scrape type for JZ87275: 0
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: FX41600
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: PG45214
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: DM05326
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: KW25734
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: BM25551
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: PA24175
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: WR10994
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: AM93614
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: WK36694
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: DD23905
2026-03-30 12:01:13 [auto1.fr] INFO: Found listing with ID: ZZ46494
2026-03-30 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ46494%27 HTTP/1.1" 200 None
2026-03-30 12:01:13 [auto1.fr] INFO: Scrape type for ZZ46494: 0
2026-03-30 12:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:14 [auto1.fr] INFO: Channel: 24h | Page: 109 | totalHits: 5685 | hits on page: 40
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: SS41282
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: TZ89802
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ89802%27 HTTP/1.1" 200 None
2026-03-30 12:01:14 [auto1.fr] INFO: Scrape type for TZ89802: 0
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: ML21708
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: BM22913
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: EK36416
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EK36416%27 HTTP/1.1" 200 None
2026-03-30 12:01:14 [auto1.fr] INFO: Scrape type for EK36416: 0
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: GB77488
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB77488%27 HTTP/1.1" 200 None
2026-03-30 12:01:14 [auto1.fr] INFO: Scrape type for GB77488: 0
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: NP13285
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: XT84639
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: EE27971
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: CD31311
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: EC71268
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: RG41241
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: AX81149
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX81149%27 HTTP/1.1" 200 None
2026-03-30 12:01:14 [auto1.fr] INFO: Scrape type for AX81149: 0
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: ZN95371
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN95371%27 HTTP/1.1" 200 None
2026-03-30 12:01:14 [auto1.fr] INFO: Scrape type for ZN95371: 0
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: SH33733
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: FP58616
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP58616%27 HTTP/1.1" 200 None
2026-03-30 12:01:14 [auto1.fr] INFO: Scrape type for FP58616: 0
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: BJ19131
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: VV03257
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: EF09834
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF09834%27 HTTP/1.1" 200 None
2026-03-30 12:01:14 [auto1.fr] INFO: Scrape type for EF09834: 0
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: WA59957
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: JP63031
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP63031%27 HTTP/1.1" 200 None
2026-03-30 12:01:14 [auto1.fr] INFO: Scrape type for JP63031: 0
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: GP41524
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: YE03503
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: VY32914
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: HA41573
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA41573%27 HTTP/1.1" 200 None
2026-03-30 12:01:14 [auto1.fr] INFO: Scrape type for HA41573: 0
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: KB68741
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: SH12813
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SH12813%27 HTTP/1.1" 200 None
2026-03-30 12:01:14 [auto1.fr] INFO: Scrape type for SH12813: 0
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: MP60855
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP60855%27 HTTP/1.1" 200 None
2026-03-30 12:01:14 [auto1.fr] INFO: Scrape type for MP60855: 0
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: LJ78621
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ78621%27 HTTP/1.1" 200 None
2026-03-30 12:01:14 [auto1.fr] INFO: Scrape type for LJ78621: 0
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: TA69138
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA69138%27 HTTP/1.1" 200 None
2026-03-30 12:01:14 [auto1.fr] INFO: Scrape type for TA69138: 0
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: NB91353
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: XN52554
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: FL47243
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: ZL69996
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: GU32917
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: ER23883
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: ZV63731
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: HF30950
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: KW37033
2026-03-30 12:01:14 [auto1.fr] INFO: Found listing with ID: ZY58741
2026-03-30 12:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:51 [auto1.fr] INFO: Channel: 24h | Page: 110 | totalHits: 5687 | hits on page: 40
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: KW37033
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: ZY58741
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: WE39904
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: HS91891
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: FM00457
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: DE33951
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: DA44919
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: CU36394
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: BS99622
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: XP32748
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: HC30106
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC30106%27 HTTP/1.1" 200 None
2026-03-30 12:01:51 [auto1.fr] INFO: Scrape type for HC30106: 0
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: PA65311
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: GD06145
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD06145%27 HTTP/1.1" 200 None
2026-03-30 12:01:51 [auto1.fr] INFO: Scrape type for GD06145: 0
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: RF21195
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF21195%27 HTTP/1.1" 200 None
2026-03-30 12:01:51 [auto1.fr] INFO: Scrape type for RF21195: 0
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: SM91019
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: YE87742
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: CB87490
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: FH08940
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: UF21819
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: CU50423
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: ZM15968
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZM15968%27 HTTP/1.1" 200 None
2026-03-30 12:01:51 [auto1.fr] INFO: Scrape type for ZM15968: 0
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: EY07006
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: VL00356
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: WX93331
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX93331%27 HTTP/1.1" 200 None
2026-03-30 12:01:51 [auto1.fr] INFO: Scrape type for WX93331: 0
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: NY89050
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY89050%27 HTTP/1.1" 200 None
2026-03-30 12:01:51 [auto1.fr] INFO: Scrape type for NY89050: 0
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: HD25218
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD25218%27 HTTP/1.1" 200 None
2026-03-30 12:01:51 [auto1.fr] INFO: Scrape type for HD25218: 0
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: JH25784
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: NS96856
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS96856%27 HTTP/1.1" 200 None
2026-03-30 12:01:51 [auto1.fr] INFO: Scrape type for NS96856: 0
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: KM12903
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM12903%27 HTTP/1.1" 200 None
2026-03-30 12:01:51 [auto1.fr] INFO: Scrape type for KM12903: 0
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: LY42330
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: MJ29292
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: NW41550
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: FB89695
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB89695%27 HTTP/1.1" 200 None
2026-03-30 12:01:51 [auto1.fr] INFO: Scrape type for FB89695: 0
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: UX84994
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: UN28055
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN28055%27 HTTP/1.1" 200 None
2026-03-30 12:01:51 [auto1.fr] INFO: Scrape type for UN28055: 0
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: YY14821
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: VU85213
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU85213%27 HTTP/1.1" 200 None
2026-03-30 12:01:51 [auto1.fr] INFO: Scrape type for VU85213: 0
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: NE69651
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: BS13354
2026-03-30 12:01:51 [auto1.fr] INFO: Found listing with ID: GF40263
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF40263%27 HTTP/1.1" 200 None
2026-03-30 12:01:51 [auto1.fr] INFO: Scrape type for GF40263: 0
2026-03-30 12:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:05 [scrapy.extensions.logstats] INFO: Crawled 356 pages (at 4 pages/min), scraped 226 items (at 1 items/min)
2026-03-30 12:02:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:03:05 [scrapy.extensions.logstats] INFO: Crawled 356 pages (at 0 pages/min), scraped 226 items (at 0 items/min)
2026-03-30 12:03:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:04:01 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.390(s), this was the 1st time calling it.
2026-03-30 12:04:01 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.3620814943060746 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:04:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:04:05 [scrapy.extensions.logstats] INFO: Crawled 356 pages (at 0 pages/min), scraped 226 items (at 0 items/min)
2026-03-30 12:04:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:05:05 [scrapy.extensions.logstats] INFO: Crawled 356 pages (at 0 pages/min), scraped 226 items (at 0 items/min)
2026-03-30 12:05:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:07 [auto1.fr] INFO: Channel: 24h | Page: 111 | totalHits: 5698 | hits on page: 40
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: LY42330
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: MJ29292
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: NW41550
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: FB89695
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB89695%27 HTTP/1.1" 200 None
2026-03-30 12:05:07 [auto1.fr] INFO: Scrape type for FB89695: 0
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: UX84994
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: UN28055
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN28055%27 HTTP/1.1" 200 None
2026-03-30 12:05:07 [auto1.fr] INFO: Scrape type for UN28055: 0
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: YY14821
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: VU85213
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU85213%27 HTTP/1.1" 200 None
2026-03-30 12:05:07 [auto1.fr] INFO: Scrape type for VU85213: 0
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: NE69651
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: BS13354
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: GF40263
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF40263%27 HTTP/1.1" 200 None
2026-03-30 12:05:07 [auto1.fr] INFO: Scrape type for GF40263: 0
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: UZ92787
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ92787%27 HTTP/1.1" 200 None
2026-03-30 12:05:07 [auto1.fr] INFO: Scrape type for UZ92787: 0
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: KB53057
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: RF64734
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: FU24714
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: AU93823
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: BX37071
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: SF44343
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: BL47384
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: CP45146
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: KA08025
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: HT47034
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT47034%27 HTTP/1.1" 200 None
2026-03-30 12:05:07 [auto1.fr] INFO: Scrape type for HT47034: 0
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: RA87670
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: FD49432
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: CK84283
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: MM83925
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: XB56810
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB56810%27 HTTP/1.1" 200 None
2026-03-30 12:05:07 [auto1.fr] INFO: Scrape type for XB56810: 0
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: VC57720
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: UL91596
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: SR78214
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: ZA29038
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: SL99392
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: HH84744
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: XF85427
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: EY61288
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: CG44888
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: XE41092
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE41092%27 HTTP/1.1" 200 None
2026-03-30 12:05:07 [auto1.fr] INFO: Scrape type for XE41092: 0
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: UV16444
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: NL40809
2026-03-30 12:05:07 [auto1.fr] INFO: Found listing with ID: KC44664
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC44664%27 HTTP/1.1" 200 None
2026-03-30 12:05:07 [auto1.fr] INFO: Scrape type for KC44664: 0
2026-03-30 12:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:12 [auto1.fr] INFO: Channel: 24h | Page: 112 | totalHits: 5698 | hits on page: 40
2026-03-30 12:05:12 [auto1.fr] INFO: Found listing with ID: TC43521
2026-03-30 12:05:12 [auto1.fr] INFO: Found listing with ID: XP49606
2026-03-30 12:05:12 [auto1.fr] INFO: Found listing with ID: DA43353
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA43353%27 HTTP/1.1" 200 None
2026-03-30 12:05:12 [auto1.fr] INFO: Scrape type for DA43353: 0
2026-03-30 12:05:12 [auto1.fr] INFO: Found listing with ID: FT37919
2026-03-30 12:05:12 [auto1.fr] INFO: Found listing with ID: MP37430
2026-03-30 12:05:12 [auto1.fr] INFO: Found listing with ID: TW29990
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW29990%27 HTTP/1.1" 200 None
2026-03-30 12:05:12 [auto1.fr] INFO: Scrape type for TW29990: 0
2026-03-30 12:05:12 [auto1.fr] INFO: Found listing with ID: YG34016
2026-03-30 12:05:12 [auto1.fr] INFO: Found listing with ID: TE79860
2026-03-30 12:05:12 [auto1.fr] INFO: Found listing with ID: HP22884
2026-03-30 12:05:12 [auto1.fr] INFO: Found listing with ID: WE10881
2026-03-30 12:05:12 [auto1.fr] INFO: Found listing with ID: WH99497
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WH99497%27 HTTP/1.1" 200 None
2026-03-30 12:05:12 [auto1.fr] INFO: Scrape type for WH99497: 2
2026-03-30 12:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56d4d20b-b5a6-5a4c-ae99-de1002c37c66 with identifier: WH99497
2026-03-30 12:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56d4d20b-b5a6-5a4c-ae99-de1002c37c66 with scrape type 2
2026-03-30 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56d4d20b-b5a6-5a4c-ae99-de1002c37c66 with scrape type 2
2026-03-30 12:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 56d4d20b-b5a6-5a4c-ae99-de1002c37c66, identifier: WH99497
2026-03-30 12:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 56d4d20b-b5a6-5a4c-ae99-de1002c37c66 with identifier: WH99497
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-30 12:05:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 56d4d20b-b5a6-5a4c-ae99-de1002c37c66 with identifier: WH99497
2026-03-30 12:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 56d4d20b-b5a6-5a4c-ae99-de1002c37c66 with identifier: WH99497 to the API
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:53:18Z',
'fuel_type': 'petrol',
'id': '56d4d20b-b5a6-5a4c-ae99-de1002c37c66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH99497',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 110520,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-26',
'seller_name': None,
'title': 'Citroen C3 1.2 VTi Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2013}
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WH99497%27 HTTP/1.1" 200 None
2026-03-30 12:05:12 [auto1.fr] INFO: Saving data for WH99497: {'auction_closing_time': 1774885998.0, 'created_time': 1774598731.896122, 'last_price_update_time': 1774872312.966646}
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WH99497') HTTP/1.1" 204 0
2026-03-30 12:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: AW06582
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: VT88303
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT88303%27 HTTP/1.1" 200 None
2026-03-30 12:05:13 [auto1.fr] INFO: Scrape type for VT88303: 0
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: UD81721
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD81721%27 HTTP/1.1" 200 None
2026-03-30 12:05:13 [auto1.fr] INFO: Scrape type for UD81721: 0
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: CP93546
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP93546%27 HTTP/1.1" 200 None
2026-03-30 12:05:13 [auto1.fr] INFO: Scrape type for CP93546: 0
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: LM45033
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: GD10850
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: JR53691
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: XB97503
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB97503%27 HTTP/1.1" 200 None
2026-03-30 12:05:13 [auto1.fr] INFO: Scrape type for XB97503: 0
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: ZZ21531
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ21531%27 HTTP/1.1" 200 None
2026-03-30 12:05:13 [auto1.fr] INFO: Scrape type for ZZ21531: 0
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: ME85478
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: TW65411
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: UN42713
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN42713%27 HTTP/1.1" 200 None
2026-03-30 12:05:13 [auto1.fr] INFO: Scrape type for UN42713: 0
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: BN30584
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN30584%27 HTTP/1.1" 200 None
2026-03-30 12:05:13 [auto1.fr] INFO: Scrape type for BN30584: 0
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: KK73571
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: LL32423
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: AV47121
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: HF97792
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: UP56954
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UP56954%27 HTTP/1.1" 200 None
2026-03-30 12:05:13 [auto1.fr] INFO: Scrape type for UP56954: 2
2026-03-30 12:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79b85ee3-9337-506b-a462-8a90078119c4 with identifier: UP56954
2026-03-30 12:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79b85ee3-9337-506b-a462-8a90078119c4 with scrape type 2
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79b85ee3-9337-506b-a462-8a90078119c4 with scrape type 2
2026-03-30 12:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 79b85ee3-9337-506b-a462-8a90078119c4, identifier: UP56954
2026-03-30 12:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 79b85ee3-9337-506b-a462-8a90078119c4 with identifier: UP56954
2026-03-30 12:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 79b85ee3-9337-506b-a462-8a90078119c4 with identifier: UP56954
2026-03-30 12:05:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 79b85ee3-9337-506b-a462-8a90078119c4 with identifier: UP56954 to the API
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:47:05Z',
'fuel_type': 'diesel',
'id': '79b85ee3-9337-506b-a462-8a90078119c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP56954',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 158335,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-26',
'seller_name': None,
'title': 'BMW 2er 216d Active Tourer Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2018}
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UP56954%27 HTTP/1.1" 200 None
2026-03-30 12:05:13 [auto1.fr] INFO: Saving data for UP56954: {'auction_closing_time': 1774885625.0, 'created_time': 1773675458.432012, 'last_price_update_time': 1774872313.615681}
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UP56954') HTTP/1.1" 204 0
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: UR46637
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: NF53447
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: ET93179
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: KL75694
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: VJ30522
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: CH12895
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: WL42720
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: XJ04578
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: DM26560
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: LZ11575
2026-03-30 12:05:13 [auto1.fr] INFO: Found listing with ID: XT87850
2026-03-30 12:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:14 [auto1.fr] INFO: Channel: 24h | Page: 113 | totalHits: 5698 | hits on page: 40
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: EY02947
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: VD42608
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: CV47418
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: NC23739
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: XV71586
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: RK11371
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: RU65332
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: KU09289
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU09289%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [auto1.fr] INFO: Scrape type for KU09289: 0
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: BX31241
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: DT31778
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: YX14767
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX14767%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [auto1.fr] INFO: Scrape type for YX14767: 0
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: VM45990
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: LC46010
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: GJ22712
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: VE21844
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: FW75721
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: KC97649
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: HP32037
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: VP08253
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: CX01779
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: DB74353
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: CF59045
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF59045%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [auto1.fr] INFO: Scrape type for CF59045: 0
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: FN04245
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FN04245%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [auto1.fr] INFO: Scrape type for FN04245: 0
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: FV30159
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: GT29202
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT29202%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [auto1.fr] INFO: Scrape type for GT29202: 0
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: CM68492
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: YM32264
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: TA32648
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA32648%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [auto1.fr] INFO: Scrape type for TA32648: 0
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: VH92035
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: VF74700
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: AZ12396
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: EJ48081
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: MJ79043
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: GY82618
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: BR67887
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR67887%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [auto1.fr] INFO: Scrape type for BR67887: 0
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: GR09269
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: YY18278
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: AY91860
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: ZZ67013
2026-03-30 12:05:14 [auto1.fr] INFO: Found listing with ID: UP31918
2026-03-30 12:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:05 [scrapy.extensions.logstats] INFO: Crawled 359 pages (at 3 pages/min), scraped 228 items (at 2 items/min)
2026-03-30 12:06:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:22 [auto1.fr] INFO: Channel: 24h | Page: 114 | totalHits: 5701 | hits on page: 40
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: AY91860
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: ZZ67013
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: UP31918
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: PX91967
2026-03-30 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX91967%27 HTTP/1.1" 200 None
2026-03-30 12:06:22 [auto1.fr] INFO: Scrape type for PX91967: 0
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: TU05858
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: HC58992
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: LK51820
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: GS17266
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: BT56168
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: RM18696
2026-03-30 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM18696%27 HTTP/1.1" 200 None
2026-03-30 12:06:22 [auto1.fr] INFO: Scrape type for RM18696: 0
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: HP37519
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: UM45421
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: FW66356
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: NU51886
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: FR21898
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: AT20727
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: WG19143
2026-03-30 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG19143%27 HTTP/1.1" 200 None
2026-03-30 12:06:22 [auto1.fr] INFO: Scrape type for WG19143: 0
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: CZ82631
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: AT81791
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: NG42802
2026-03-30 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG42802%27 HTTP/1.1" 200 None
2026-03-30 12:06:22 [auto1.fr] INFO: Scrape type for NG42802: 0
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: DN03508
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: KL74620
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: BH93071
2026-03-30 12:06:22 [auto1.fr] INFO: Found listing with ID: PF16062
2026-03-30 12:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF16062%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [auto1.fr] INFO: Scrape type for PF16062: 0
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: YT08799
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: JL76183
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL76183%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [auto1.fr] INFO: Scrape type for JL76183: 0
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: JC39460
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: DE96742
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: GK54284
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: LH76709
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: SF01086
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF01086%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [auto1.fr] INFO: Scrape type for SF01086: 0
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: WV93333
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: RC05941
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: EM83607
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: CU95310
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: BL19130
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: BP34211
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: CU30754
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: PZ88800
2026-03-30 12:06:23 [auto1.fr] INFO: Found listing with ID: ZD76165
2026-03-30 12:06:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:05 [scrapy.extensions.logstats] INFO: Crawled 360 pages (at 1 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:07:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:33 [auto1.fr] INFO: Channel: 24h | Page: 115 | totalHits: 5702 | hits on page: 40
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: ZD76165
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: MY43858
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: DA93412
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: TP61370
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: DH45379
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: ZA49017
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: DJ09425
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: AX98718
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: SX33425
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: VT19778
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: TR39928
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: YJ06296
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: HB16314
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: NG39505
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: SD25864
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: AW19265
2026-03-30 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW19265%27 HTTP/1.1" 200 None
2026-03-30 12:07:33 [auto1.fr] INFO: Scrape type for AW19265: 0
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: DL07367
2026-03-30 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL07367%27 HTTP/1.1" 200 None
2026-03-30 12:07:33 [auto1.fr] INFO: Scrape type for DL07367: 0
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: TK04922
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: XH55125
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: GL57074
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: JG67142
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: VT66374
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: CU22233
2026-03-30 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU22233%27 HTTP/1.1" 200 None
2026-03-30 12:07:33 [auto1.fr] INFO: Scrape type for CU22233: 0
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: PD03654
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: YZ13186
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: YS67726
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: ZL05280
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: TZ91470
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: WS31397
2026-03-30 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS31397%27 HTTP/1.1" 200 None
2026-03-30 12:07:33 [auto1.fr] INFO: Scrape type for WS31397: 0
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: JN14468
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: SV76082
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: VR68825
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: SE24151
2026-03-30 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE24151%27 HTTP/1.1" 200 None
2026-03-30 12:07:33 [auto1.fr] INFO: Scrape type for SE24151: 0
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: FX98365
2026-03-30 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX98365%27 HTTP/1.1" 200 None
2026-03-30 12:07:33 [auto1.fr] INFO: Scrape type for FX98365: 0
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: EX11392
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: AT49366
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: NZ33363
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: EH26711
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: LL72908
2026-03-30 12:07:33 [auto1.fr] INFO: Found listing with ID: SD92574
2026-03-30 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD92574%27 HTTP/1.1" 200 None
2026-03-30 12:07:33 [auto1.fr] INFO: Scrape type for SD92574: 0
2026-03-30 12:07:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:45 [auto1.fr] INFO: Channel: 24h | Page: 116 | totalHits: 5703 | hits on page: 40
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: SD92574
2026-03-30 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD92574%27 HTTP/1.1" 200 None
2026-03-30 12:07:45 [auto1.fr] INFO: Scrape type for SD92574: 0
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: CY43470
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: SV67354
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: RB55896
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: XW31982
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: NJ59520
2026-03-30 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ59520%27 HTTP/1.1" 200 None
2026-03-30 12:07:45 [auto1.fr] INFO: Scrape type for NJ59520: 0
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: GG29325
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: HZ30710
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: LZ69569
2026-03-30 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ69569%27 HTTP/1.1" 200 None
2026-03-30 12:07:45 [auto1.fr] INFO: Scrape type for LZ69569: 0
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: NY61092
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: ZM80023
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: TR32255
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: YS87818
2026-03-30 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS87818%27 HTTP/1.1" 200 None
2026-03-30 12:07:45 [auto1.fr] INFO: Scrape type for YS87818: 0
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: SL13789
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: AT90732
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: MS42425
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: AK39621
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: FB29476
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: CE04725
2026-03-30 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE04725%27 HTTP/1.1" 200 None
2026-03-30 12:07:45 [auto1.fr] INFO: Scrape type for CE04725: 0
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: RX87637
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: CV84017
2026-03-30 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV84017%27 HTTP/1.1" 200 None
2026-03-30 12:07:45 [auto1.fr] INFO: Scrape type for CV84017: 0
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: GB94955
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: VP23956
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: NY43606
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: CR66279
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: LL62487
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: VP92725
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: CH04753
2026-03-30 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH04753%27 HTTP/1.1" 200 None
2026-03-30 12:07:45 [auto1.fr] INFO: Scrape type for CH04753: 0
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: GZ26108
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: KB95904
2026-03-30 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB95904%27 HTTP/1.1" 200 None
2026-03-30 12:07:45 [auto1.fr] INFO: Scrape type for KB95904: 0
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: HW65969
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: KH51958
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: RL62627
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: ND58253
2026-03-30 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ND58253%27 HTTP/1.1" 200 None
2026-03-30 12:07:45 [auto1.fr] INFO: Scrape type for ND58253: 0
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: PM61458
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: TB34816
2026-03-30 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB34816%27 HTTP/1.1" 200 None
2026-03-30 12:07:45 [auto1.fr] INFO: Scrape type for TB34816: 0
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: PG50049
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: WT63906
2026-03-30 12:07:45 [auto1.fr] INFO: Found listing with ID: HR61891
2026-03-30 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HR61891%27 HTTP/1.1" 200 None
2026-03-30 12:07:46 [auto1.fr] INFO: Scrape type for HR61891: 0
2026-03-30 12:07:46 [auto1.fr] INFO: Found listing with ID: MC93057
2026-03-30 12:07:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:08:05 [scrapy.extensions.logstats] INFO: Crawled 362 pages (at 2 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:08:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:09:05 [scrapy.extensions.logstats] INFO: Crawled 362 pages (at 0 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:09:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:09:55 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.932(s), this was the 1st time calling it.
2026-03-30 12:09:55 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.287934418055571 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:10:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:10:05 [scrapy.extensions.logstats] INFO: Crawled 362 pages (at 0 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:10:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:11:05 [scrapy.extensions.logstats] INFO: Crawled 362 pages (at 0 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:11:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:12:05 [scrapy.extensions.logstats] INFO: Crawled 362 pages (at 0 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:12:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:12:11 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.104(s), this was the 2nd time calling it.
2026-03-30 12:12:11 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 8.113266834577248 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:12:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:12:25 [scrapy.core.engine] DEBUG: Crawled (401) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:25 [auto1.fr] WARNING: Received 401 for https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07 (token age: 3875.7s). Queued for retry (1 pending).
2026-03-30 12:12:25 [auto1.fr] INFO: Initiating token refresh...
2026-03-30 12:12:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:41 [auto1.fr] INFO: Token refreshed successfully. Replaying 1 pending requests.
2026-03-30 12:12:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:05 [scrapy.extensions.logstats] INFO: Crawled 364 pages (at 2 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:13:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:14:05 [scrapy.extensions.logstats] INFO: Crawled 364 pages (at 0 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:14:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:14:52 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.134(s), this was the 1st time calling it.
2026-03-30 12:14:52 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.451663792732226 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:14:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:15:05 [scrapy.extensions.logstats] INFO: Crawled 364 pages (at 0 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:15:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:16:05 [scrapy.extensions.logstats] INFO: Crawled 364 pages (at 0 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:16:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:17:05 [scrapy.extensions.logstats] INFO: Crawled 364 pages (at 0 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:17:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:17:08 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.302(s), this was the 2nd time calling it.
2026-03-30 12:17:08 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.6014159635453953 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:17:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:18:05 [scrapy.extensions.logstats] INFO: Crawled 364 pages (at 0 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:18:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:19:05 [scrapy.extensions.logstats] INFO: Crawled 364 pages (at 0 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:19:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:19:21 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 399.422(s), this was the 3rd time calling it.
2026-03-30 12:19:21 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.9912661704195145 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:19:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2026-03-30 12:20:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:03 [auto1.fr] INFO: Channel: 24h | Page: 117 | totalHits: 5740 | hits on page: 40
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: RB55896
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: XW31982
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: NJ59520
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ59520%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.fr] INFO: Scrape type for NJ59520: 0
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: GG29325
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: HZ30710
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: LZ69569
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ69569%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.fr] INFO: Scrape type for LZ69569: 0
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: NY61092
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: ZM80023
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: TR32255
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: YS87818
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS87818%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.fr] INFO: Scrape type for YS87818: 0
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: SL13789
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: AT90732
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: MS42425
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: AK39621
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: FB29476
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: CE04725
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE04725%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.fr] INFO: Scrape type for CE04725: 0
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: RX87637
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: CV84017
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV84017%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.fr] INFO: Scrape type for CV84017: 0
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: GB94955
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: VP23956
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: NY43606
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: CR66279
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: LL62487
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: VP92725
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: CH04753
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH04753%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.fr] INFO: Scrape type for CH04753: 0
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: GZ26108
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: KB95904
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB95904%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.fr] INFO: Scrape type for KB95904: 0
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: HW65969
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: KH51958
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: RL62627
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: ND58253
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ND58253%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.fr] INFO: Scrape type for ND58253: 0
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: PM61458
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: TB34816
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB34816%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.fr] INFO: Scrape type for TB34816: 0
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: PG50049
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: WT63906
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: HR61891
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HR61891%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.fr] INFO: Scrape type for HR61891: 0
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: MC93057
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: WN65697
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: JS64389
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JS64389%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.fr] INFO: Scrape type for JS64389: 0
2026-03-30 12:20:04 [auto1.fr] INFO: Found listing with ID: SL82812
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL82812%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.fr] INFO: Scrape type for SL82812: 0
2026-03-30 12:20:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:05 [scrapy.extensions.logstats] INFO: Crawled 365 pages (at 1 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:20:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:21:05 [scrapy.extensions.logstats] INFO: Crawled 365 pages (at 0 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:21:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:10 [auto1.fr] INFO: Channel: 24h | Page: 118 | totalHits: 5743 | hits on page: 40
2026-03-30 12:21:10 [auto1.fr] INFO: Found listing with ID: WN65697
2026-03-30 12:21:10 [auto1.fr] INFO: Found listing with ID: JS64389
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JS64389%27 HTTP/1.1" 200 None
2026-03-30 12:21:10 [auto1.fr] INFO: Scrape type for JS64389: 0
2026-03-30 12:21:10 [auto1.fr] INFO: Found listing with ID: SL82812
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL82812%27 HTTP/1.1" 200 None
2026-03-30 12:21:10 [auto1.fr] INFO: Scrape type for SL82812: 0
2026-03-30 12:21:10 [auto1.fr] INFO: Found listing with ID: FV70954
2026-03-30 12:21:10 [auto1.fr] INFO: Found listing with ID: UG11231
2026-03-30 12:21:10 [auto1.fr] INFO: Found listing with ID: HX49968
2026-03-30 12:21:10 [auto1.fr] INFO: Found listing with ID: MG59529
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG59529%27 HTTP/1.1" 200 None
2026-03-30 12:21:10 [auto1.fr] INFO: Scrape type for MG59529: 0
2026-03-30 12:21:10 [auto1.fr] INFO: Found listing with ID: SB38361
2026-03-30 12:21:10 [auto1.fr] INFO: Found listing with ID: JT24532
2026-03-30 12:21:10 [auto1.fr] INFO: Found listing with ID: TY88704
2026-03-30 12:21:10 [auto1.fr] INFO: Found listing with ID: FY78807
2026-03-30 12:21:10 [auto1.fr] INFO: Found listing with ID: SK92055
2026-03-30 12:21:10 [auto1.fr] INFO: Found listing with ID: NM97530
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM97530%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [auto1.fr] INFO: Scrape type for NM97530: 0
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: XL87843
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: PM49517
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: GZ59625
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ59625%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [auto1.fr] INFO: Scrape type for GZ59625: 0
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: XP17198
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: GN98796
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN98796%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [auto1.fr] INFO: Scrape type for GN98796: 0
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: JU80651
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU80651%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [auto1.fr] INFO: Scrape type for JU80651: 0
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: MM63788
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: DR23602
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: MG88559
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG88559%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [auto1.fr] INFO: Scrape type for MG88559: 0
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: ZP94396
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: ZC11276
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: ZU13538
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: WY25382
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY25382%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [auto1.fr] INFO: Scrape type for WY25382: 0
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: DR43317
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: WF83429
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: PM54626
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM54626%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [auto1.fr] INFO: Scrape type for PM54626: 0
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: KC00053
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: XT87839
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: WA19421
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: RT00680
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT00680%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [auto1.fr] INFO: Scrape type for RT00680: 0
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: LH70216
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH70216%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [auto1.fr] INFO: Scrape type for LH70216: 0
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: XX17277
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: YF14026
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: RT97510
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: JU05090
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: VL98028
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL98028%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [auto1.fr] INFO: Scrape type for VL98028: 0
2026-03-30 12:21:11 [auto1.fr] INFO: Found listing with ID: CC89861
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC89861%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [auto1.fr] INFO: Scrape type for CC89861: 0
2026-03-30 12:21:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:15 [auto1.fr] INFO: Channel: 24h | Page: 119 | totalHits: 5743 | hits on page: 40
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: AH00792
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: GS03984
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: BZ30264
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: SC97617
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: WJ36021
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: CW00157
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: FP08474
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: GE69678
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: MA92859
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: NS97221
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: PD78031
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD78031%27 HTTP/1.1" 200 None
2026-03-30 12:21:15 [auto1.fr] INFO: Scrape type for PD78031: 0
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: UM97504
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: NP12584
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: NW12162
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW12162%27 HTTP/1.1" 200 None
2026-03-30 12:21:15 [auto1.fr] INFO: Scrape type for NW12162: 0
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: WV73236
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: UR57838
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: SN63946
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: MA29780
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA29780%27 HTTP/1.1" 200 None
2026-03-30 12:21:15 [auto1.fr] INFO: Scrape type for MA29780: 0
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: ZH47004
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH47004%27 HTTP/1.1" 200 None
2026-03-30 12:21:15 [auto1.fr] INFO: Scrape type for ZH47004: 0
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: KP94491
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: WS68966
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS68966%27 HTTP/1.1" 200 None
2026-03-30 12:21:15 [auto1.fr] INFO: Scrape type for WS68966: 0
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: AU48197
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: WN86171
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: CJ92637
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ92637%27 HTTP/1.1" 200 None
2026-03-30 12:21:15 [auto1.fr] INFO: Scrape type for CJ92637: 0
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: KN59996
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN59996%27 HTTP/1.1" 200 None
2026-03-30 12:21:15 [auto1.fr] INFO: Scrape type for KN59996: 0
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: BM17669
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: YA54656
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: FP89047
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP89047%27 HTTP/1.1" 200 None
2026-03-30 12:21:15 [auto1.fr] INFO: Scrape type for FP89047: 0
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: GZ97506
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: RL60672
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: UF83440
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF83440%27 HTTP/1.1" 200 None
2026-03-30 12:21:15 [auto1.fr] INFO: Scrape type for UF83440: 0
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: NY72412
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: ZH72622
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: GM29427
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: WA46854
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA46854%27 HTTP/1.1" 200 None
2026-03-30 12:21:15 [auto1.fr] INFO: Scrape type for WA46854: 0
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: AD46957
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: YP51372
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: GU93912
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU93912%27 HTTP/1.1" 200 None
2026-03-30 12:21:15 [auto1.fr] INFO: Scrape type for GU93912: 0
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: TY87509
2026-03-30 12:21:15 [auto1.fr] INFO: Found listing with ID: DB83162
2026-03-30 12:21:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:16 [auto1.fr] INFO: Channel: 24h | Page: 120 | totalHits: 5743 | hits on page: 40
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: PX06579
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX06579%27 HTTP/1.1" 200 None
2026-03-30 12:21:16 [auto1.fr] INFO: Scrape type for PX06579: 0
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: BF66000
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: SY82674
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SY82674%27 HTTP/1.1" 200 None
2026-03-30 12:21:16 [auto1.fr] INFO: Scrape type for SY82674: 0
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: GS73075
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: TS40917
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: FL76825
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: VY74819
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: JE10155
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: ZK08219
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: KS28661
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: SF06109
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: AD83695
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: BS21555
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS21555%27 HTTP/1.1" 200 None
2026-03-30 12:21:16 [auto1.fr] INFO: Scrape type for BS21555: 0
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: JF07338
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: HE67645
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HE67645%27 HTTP/1.1" 200 None
2026-03-30 12:21:16 [auto1.fr] INFO: Scrape type for HE67645: 0
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: JD39110
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: JR78499
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR78499%27 HTTP/1.1" 200 None
2026-03-30 12:21:16 [auto1.fr] INFO: Scrape type for JR78499: 0
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: NZ21389
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ21389%27 HTTP/1.1" 200 None
2026-03-30 12:21:16 [auto1.fr] INFO: Scrape type for NZ21389: 0
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: DK56900
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: BF56571
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: YH44031
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: WJ13583
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: UR58617
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UR58617%27 HTTP/1.1" 200 None
2026-03-30 12:21:16 [auto1.fr] INFO: Scrape type for UR58617: 0
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: TE19039
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: CK21473
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: WG06663
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: PA78315
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: TL95949
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: XS62147
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS62147%27 HTTP/1.1" 200 None
2026-03-30 12:21:16 [auto1.fr] INFO: Scrape type for XS62147: 0
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: AC86426
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: TH94226
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TH94226%27 HTTP/1.1" 200 None
2026-03-30 12:21:16 [auto1.fr] INFO: Scrape type for TH94226: 0
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: RG30279
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG30279%27 HTTP/1.1" 200 None
2026-03-30 12:21:16 [auto1.fr] INFO: Scrape type for RG30279: 0
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: TN71254
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: DJ31121
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ31121%27 HTTP/1.1" 200 None
2026-03-30 12:21:16 [auto1.fr] INFO: Scrape type for DJ31121: 0
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: KJ24442
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: MX62937
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: UV38858
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: FS76185
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: DS23730
2026-03-30 12:21:16 [auto1.fr] INFO: Found listing with ID: JL93468
2026-03-30 12:21:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:22:05 [scrapy.extensions.logstats] INFO: Crawled 368 pages (at 3 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:22:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:23:05 [scrapy.extensions.logstats] INFO: Crawled 368 pages (at 0 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:23:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:23:26 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.000(s), this was the 1st time calling it.
2026-03-30 12:23:26 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.084056920696578 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:23:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:23:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:50 [auto1.fr] INFO: Channel: 24h | Page: 121 | totalHits: 5752 | hits on page: 40
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: RG30279
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG30279%27 HTTP/1.1" 200 None
2026-03-30 12:23:50 [auto1.fr] INFO: Scrape type for RG30279: 0
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: TN71254
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: DJ31121
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ31121%27 HTTP/1.1" 200 None
2026-03-30 12:23:50 [auto1.fr] INFO: Scrape type for DJ31121: 0
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: KJ24442
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: MX62937
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: UV38858
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: FS76185
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: DS23730
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: JL93468
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: CM39472
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM39472%27 HTTP/1.1" 200 None
2026-03-30 12:23:50 [auto1.fr] INFO: Scrape type for CM39472: 0
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: ZL28145
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: JY97748
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: JF96237
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: HG27801
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: AA14547
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: CE08433
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE08433%27 HTTP/1.1" 200 None
2026-03-30 12:23:50 [auto1.fr] INFO: Scrape type for CE08433: 0
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: ZN02557
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: EN42354
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: GL68159
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: RM20172
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: EE83883
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: HS48981
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: HD10774
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD10774%27 HTTP/1.1" 200 None
2026-03-30 12:23:50 [auto1.fr] INFO: Scrape type for HD10774: 0
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: SZ93717
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: WF53707
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: RE72510
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: AV92189
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: PK04898
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: PD48393
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: PT64266
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: PE67276
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE67276%27 HTTP/1.1" 200 None
2026-03-30 12:23:50 [auto1.fr] INFO: Scrape type for PE67276: 0
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: ZW54259
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: ZH66102
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: XB80018
2026-03-30 12:23:50 [auto1.fr] INFO: Found listing with ID: FK47349
2026-03-30 12:23:51 [auto1.fr] INFO: Found listing with ID: YC36334
2026-03-30 12:23:51 [auto1.fr] INFO: Found listing with ID: PS96016
2026-03-30 12:23:51 [auto1.fr] INFO: Found listing with ID: KU51052
2026-03-30 12:23:51 [auto1.fr] INFO: Found listing with ID: GC19073
2026-03-30 12:23:51 [auto1.fr] INFO: Found listing with ID: WZ07204
2026-03-30 12:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ07204%27 HTTP/1.1" 200 None
2026-03-30 12:23:51 [auto1.fr] INFO: Scrape type for WZ07204: 0
2026-03-30 12:23:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:59 [auto1.fr] INFO: Channel: 24h | Page: 122 | totalHits: 5752 | hits on page: 40
2026-03-30 12:23:59 [auto1.fr] INFO: Found listing with ID: TG10536
2026-03-30 12:23:59 [auto1.fr] INFO: Found listing with ID: RE10755
2026-03-30 12:23:59 [auto1.fr] INFO: Found listing with ID: MR81376
2026-03-30 12:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR81376%27 HTTP/1.1" 200 None
2026-03-30 12:24:00 [auto1.fr] INFO: Scrape type for MR81376: 0
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: CT54779
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: KW68314
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: JF56429
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: JP06757
2026-03-30 12:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP06757%27 HTTP/1.1" 200 None
2026-03-30 12:24:00 [auto1.fr] INFO: Scrape type for JP06757: 0
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: MU24088
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: SE16009
2026-03-30 12:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE16009%27 HTTP/1.1" 200 None
2026-03-30 12:24:00 [auto1.fr] INFO: Scrape type for SE16009: 0
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: HF25900
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: NV28779
2026-03-30 12:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV28779%27 HTTP/1.1" 200 None
2026-03-30 12:24:00 [auto1.fr] INFO: Scrape type for NV28779: 0
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: UU33853
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: GZ91230
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: WD81784
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: XA59282
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: PZ79927
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: VL19432
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: WN62407
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: GA15332
2026-03-30 12:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA15332%27 HTTP/1.1" 200 None
2026-03-30 12:24:00 [auto1.fr] INFO: Scrape type for GA15332: 0
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: JG32180
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: LV54644
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: ET22474
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: VB54274
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: WH81250
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: KG24265
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: MJ22347
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: UH55334
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: TY42768
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: ZV03608
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: TF90019
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: ZN51236
2026-03-30 12:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN51236%27 HTTP/1.1" 200 None
2026-03-30 12:24:00 [auto1.fr] INFO: Scrape type for ZN51236: 0
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: RH20698
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: JH28308
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: FX69066
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: WN78758
2026-03-30 12:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN78758%27 HTTP/1.1" 200 None
2026-03-30 12:24:00 [auto1.fr] INFO: Scrape type for WN78758: 0
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: FB52388
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: EM64243
2026-03-30 12:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EM64243%27 HTTP/1.1" 200 None
2026-03-30 12:24:00 [auto1.fr] INFO: Scrape type for EM64243: 0
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: FV29389
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: AH74667
2026-03-30 12:24:00 [auto1.fr] INFO: Found listing with ID: NL48805
2026-03-30 12:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL48805%27 HTTP/1.1" 200 None
2026-03-30 12:24:00 [auto1.fr] INFO: Scrape type for NL48805: 0
2026-03-30 12:24:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:05 [scrapy.extensions.logstats] INFO: Crawled 370 pages (at 2 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:24:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:25:05 [scrapy.extensions.logstats] INFO: Crawled 370 pages (at 0 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:25:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:26:05 [scrapy.extensions.logstats] INFO: Crawled 370 pages (at 0 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:26:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:26:10 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.630(s), this was the 1st time calling it.
2026-03-30 12:26:10 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.7073351652531414 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:26:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:26:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:15 [auto1.fr] INFO: Channel: 24h | Page: 123 | totalHits: 5759 | hits on page: 40
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: FX69066
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: WN78758
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN78758%27 HTTP/1.1" 200 None
2026-03-30 12:26:15 [auto1.fr] INFO: Scrape type for WN78758: 0
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: FB52388
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: EM64243
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EM64243%27 HTTP/1.1" 200 None
2026-03-30 12:26:15 [auto1.fr] INFO: Scrape type for EM64243: 0
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: FV29389
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: AH74667
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: NL48805
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL48805%27 HTTP/1.1" 200 None
2026-03-30 12:26:15 [auto1.fr] INFO: Scrape type for NL48805: 0
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: YG68340
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG68340%27 HTTP/1.1" 200 None
2026-03-30 12:26:15 [auto1.fr] INFO: Scrape type for YG68340: 0
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: CJ55731
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: YM43773
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: XK82108
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK82108%27 HTTP/1.1" 200 None
2026-03-30 12:26:15 [auto1.fr] INFO: Scrape type for XK82108: 0
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: NV36409
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV36409%27 HTTP/1.1" 200 None
2026-03-30 12:26:15 [auto1.fr] INFO: Scrape type for NV36409: 0
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: KX72763
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX72763%27 HTTP/1.1" 200 None
2026-03-30 12:26:15 [auto1.fr] INFO: Scrape type for KX72763: 0
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: MC34871
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: NH75420
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH75420%27 HTTP/1.1" 200 None
2026-03-30 12:26:15 [auto1.fr] INFO: Scrape type for NH75420: 0
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: UW89865
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW89865%27 HTTP/1.1" 200 None
2026-03-30 12:26:15 [auto1.fr] INFO: Scrape type for UW89865: 0
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: JN66060
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: BX33058
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX33058%27 HTTP/1.1" 200 None
2026-03-30 12:26:15 [auto1.fr] INFO: Scrape type for BX33058: 0
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: LH95044
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: VF82485
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: MP91388
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: TR54238
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: WH66120
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: ZK60890
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: ER89848
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: MR72983
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: YZ93571
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ93571%27 HTTP/1.1" 200 None
2026-03-30 12:26:15 [auto1.fr] INFO: Scrape type for YZ93571: 0
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: DC15734
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: XE57968
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE57968%27 HTTP/1.1" 200 None
2026-03-30 12:26:15 [auto1.fr] INFO: Scrape type for XE57968: 0
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: SC77691
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: BE42627
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE42627%27 HTTP/1.1" 200 None
2026-03-30 12:26:15 [auto1.fr] INFO: Scrape type for BE42627: 0
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: GG81995
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: CR42714
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: CE35297
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: JH24674
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: VH64619
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: ZP19975
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: YP11132
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: SL68858
2026-03-30 12:26:15 [auto1.fr] INFO: Found listing with ID: PD71096
2026-03-30 12:26:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:41 [auto1.fr] INFO: Channel: 24h | Page: 124 | totalHits: 5759 | hits on page: 40
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: JG27531
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: JE50651
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: PX74554
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: MS48423
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: FC94374
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: PF58698
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: RW58754
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: ZU75776
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: MD77771
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: GP33170
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: EL53506
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: NP36468
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: LZ22019
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ22019%27 HTTP/1.1" 200 None
2026-03-30 12:26:41 [auto1.fr] INFO: Scrape type for LZ22019: 0
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: ZJ62957
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ62957%27 HTTP/1.1" 200 None
2026-03-30 12:26:41 [auto1.fr] INFO: Scrape type for ZJ62957: 0
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: HV65462
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: SL84950
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: HF65645
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: MZ97980
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: PF58215
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF58215%27 HTTP/1.1" 200 None
2026-03-30 12:26:41 [auto1.fr] INFO: Scrape type for PF58215: 0
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: DC84822
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: WY90257
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY90257%27 HTTP/1.1" 200 None
2026-03-30 12:26:41 [auto1.fr] INFO: Scrape type for WY90257: 0
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: DY58441
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DY58441%27 HTTP/1.1" 200 None
2026-03-30 12:26:41 [auto1.fr] INFO: Scrape type for DY58441: 0
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: HA57623
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: YA52294
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: RA71282
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: GT00175
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT00175%27 HTTP/1.1" 200 None
2026-03-30 12:26:41 [auto1.fr] INFO: Scrape type for GT00175: 0
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: XM02114
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XM02114%27 HTTP/1.1" 200 None
2026-03-30 12:26:41 [auto1.fr] INFO: Scrape type for XM02114: 0
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: WD54427
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: CL62948
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: SA02986
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: DX76467
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: RW82157
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW82157%27 HTTP/1.1" 200 None
2026-03-30 12:26:41 [auto1.fr] INFO: Scrape type for RW82157: 0
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: AX33817
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX33817%27 HTTP/1.1" 200 None
2026-03-30 12:26:41 [auto1.fr] INFO: Scrape type for AX33817: 0
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: XR16866
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: SG67985
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: VS23726
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: GR64751
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: SH10737
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SH10737%27 HTTP/1.1" 200 None
2026-03-30 12:26:41 [auto1.fr] INFO: Scrape type for SH10737: 0
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: UF65661
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: EF99647
2026-03-30 12:26:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:43 [auto1.fr] INFO: Channel: 24h | Page: 125 | totalHits: 5759 | hits on page: 40
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: LT84198
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT84198%27 HTTP/1.1" 200 None
2026-03-30 12:26:43 [auto1.fr] INFO: Scrape type for LT84198: 0
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: XX91419
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XX91419%27 HTTP/1.1" 200 None
2026-03-30 12:26:43 [auto1.fr] INFO: Scrape type for XX91419: 0
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: NK21685
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: CK35562
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: GS65981
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS65981%27 HTTP/1.1" 200 None
2026-03-30 12:26:43 [auto1.fr] INFO: Scrape type for GS65981: 0
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: HN41190
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN41190%27 HTTP/1.1" 200 None
2026-03-30 12:26:43 [auto1.fr] INFO: Scrape type for HN41190: 0
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: SV57459
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: HK63767
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: JH18502
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: FE45275
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: RP20789
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: ZL56618
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: WX60393
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX60393%27 HTTP/1.1" 200 None
2026-03-30 12:26:43 [auto1.fr] INFO: Scrape type for WX60393: 0
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: AJ70757
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: KL87696
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL87696%27 HTTP/1.1" 200 None
2026-03-30 12:26:43 [auto1.fr] INFO: Scrape type for KL87696: 0
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: KT17553
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KT17553%27 HTTP/1.1" 200 None
2026-03-30 12:26:43 [auto1.fr] INFO: Scrape type for KT17553: 0
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: SX76014
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: DD75510
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: ZF23948
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: WM84463
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: JR93162
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: SW20172
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SW20172%27 HTTP/1.1" 200 None
2026-03-30 12:26:43 [auto1.fr] INFO: Scrape type for SW20172: 0
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: PY97229
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY97229%27 HTTP/1.1" 200 None
2026-03-30 12:26:43 [auto1.fr] INFO: Scrape type for PY97229: 0
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: NW87913
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: TU34915
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: NJ82872
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: GA67039
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: NT26792
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT26792%27 HTTP/1.1" 200 None
2026-03-30 12:26:43 [auto1.fr] INFO: Scrape type for NT26792: 0
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: LH59287
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: BT80700
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: AB99439
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: WL89237
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: GB80878
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB80878%27 HTTP/1.1" 200 None
2026-03-30 12:26:43 [auto1.fr] INFO: Scrape type for GB80878: 0
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: VN89560
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN89560%27 HTTP/1.1" 200 None
2026-03-30 12:26:43 [auto1.fr] INFO: Scrape type for VN89560: 0
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: XS44822
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: NJ07940
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: MN50971
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: MP79146
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: GD28523
2026-03-30 12:26:43 [auto1.fr] INFO: Found listing with ID: LA30202
2026-03-30 12:26:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:52 [auto1.fr] INFO: Channel: 24h | Page: 126 | totalHits: 5759 | hits on page: 40
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: FJ71814
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: SF71257
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: FP78557
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: BV80652
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV80652%27 HTTP/1.1" 200 None
2026-03-30 12:26:52 [auto1.fr] INFO: Scrape type for BV80652: 0
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: DH32796
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: PG89381
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: KG24879
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: TL59633
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: UF64082
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: BY36168
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: SJ83397
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: GT56253
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT56253%27 HTTP/1.1" 200 None
2026-03-30 12:26:52 [auto1.fr] INFO: Scrape type for GT56253: 0
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: KX27022
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX27022%27 HTTP/1.1" 200 None
2026-03-30 12:26:52 [auto1.fr] INFO: Scrape type for KX27022: 0
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: WL52555
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: FE79603
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: RK50663
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: JJ61666
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: JJ87165
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: EF05565
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF05565%27 HTTP/1.1" 200 None
2026-03-30 12:26:52 [auto1.fr] INFO: Scrape type for EF05565: 0
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: JL32870
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: MB72443
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: CU16267
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: KR18371
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: PF09480
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: HZ02689
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: VR08947
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR08947%27 HTTP/1.1" 200 None
2026-03-30 12:26:52 [auto1.fr] INFO: Scrape type for VR08947: 0
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: MG34511
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: UC52901
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: KR38014
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: VL47333
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: HK06615
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK06615%27 HTTP/1.1" 200 None
2026-03-30 12:26:52 [auto1.fr] INFO: Scrape type for HK06615: 0
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: LV60868
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LV60868%27 HTTP/1.1" 200 None
2026-03-30 12:26:52 [auto1.fr] INFO: Scrape type for LV60868: 0
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: PL58037
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL58037%27 HTTP/1.1" 200 None
2026-03-30 12:26:52 [auto1.fr] INFO: Scrape type for PL58037: 0
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: EJ68168
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: KR22803
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: ZF22260
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: DX15659
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DX15659%27 HTTP/1.1" 200 None
2026-03-30 12:26:52 [auto1.fr] INFO: Scrape type for DX15659: 0
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: TB10298
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB10298%27 HTTP/1.1" 200 None
2026-03-30 12:26:52 [auto1.fr] INFO: Scrape type for TB10298: 0
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: PX78812
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX78812%27 HTTP/1.1" 200 None
2026-03-30 12:26:52 [auto1.fr] INFO: Scrape type for PX78812: 0
2026-03-30 12:26:52 [auto1.fr] INFO: Found listing with ID: LJ12195
2026-03-30 12:26:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:00 [auto1.fr] INFO: Channel: 24h | Page: 127 | totalHits: 5760 | hits on page: 40
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: LJ12195
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: ZS17740
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS17740%27 HTTP/1.1" 200 None
2026-03-30 12:27:00 [auto1.fr] INFO: Scrape type for ZS17740: 0
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: RX29137
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX29137%27 HTTP/1.1" 200 None
2026-03-30 12:27:00 [auto1.fr] INFO: Scrape type for RX29137: 0
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: ZU85882
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: DC53423
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: EP92791
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: NU22496
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: PD96276
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: SL33104
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: YG84711
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: DP39204
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: WT10703
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT10703%27 HTTP/1.1" 200 None
2026-03-30 12:27:00 [auto1.fr] INFO: Scrape type for WT10703: 0
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: WR81420
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: LV99015
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: NE12141
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: LB65647
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: SF17635
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: DU78969
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU78969%27 HTTP/1.1" 200 None
2026-03-30 12:27:00 [auto1.fr] INFO: Scrape type for DU78969: 0
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: GF31041
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: DZ93005
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: KE95958
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: BC00467
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: NE86900
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: CA53572
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA53572%27 HTTP/1.1" 200 None
2026-03-30 12:27:00 [auto1.fr] INFO: Scrape type for CA53572: 0
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: CE77721
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE77721%27 HTTP/1.1" 200 None
2026-03-30 12:27:00 [auto1.fr] INFO: Scrape type for CE77721: 0
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: UL34830
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: UM21861
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: SN32974
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN32974%27 HTTP/1.1" 200 None
2026-03-30 12:27:00 [auto1.fr] INFO: Scrape type for SN32974: 0
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: YM66542
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: LF97734
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: GF05733
2026-03-30 12:27:00 [auto1.fr] INFO: Found listing with ID: AK36999
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK36999%27 HTTP/1.1" 200 None
2026-03-30 12:27:01 [auto1.fr] INFO: Scrape type for AK36999: 0
2026-03-30 12:27:01 [auto1.fr] INFO: Found listing with ID: DA77407
2026-03-30 12:27:01 [auto1.fr] INFO: Found listing with ID: BV78883
2026-03-30 12:27:01 [auto1.fr] INFO: Found listing with ID: GE65256
2026-03-30 12:27:01 [auto1.fr] INFO: Found listing with ID: RS84177
2026-03-30 12:27:01 [auto1.fr] INFO: Found listing with ID: BW48684
2026-03-30 12:27:01 [auto1.fr] INFO: Found listing with ID: VP49485
2026-03-30 12:27:01 [auto1.fr] INFO: Found listing with ID: MW23065
2026-03-30 12:27:01 [auto1.fr] INFO: Found listing with ID: KP63735
2026-03-30 12:27:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:05 [scrapy.extensions.logstats] INFO: Crawled 375 pages (at 5 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:27:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:28:05 [scrapy.extensions.logstats] INFO: Crawled 375 pages (at 0 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:28:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:29:05 [scrapy.extensions.logstats] INFO: Crawled 375 pages (at 0 pages/min), scraped 228 items (at 0 items/min)
2026-03-30 12:29:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:29:11 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.024(s), this was the 1st time calling it.
2026-03-30 12:29:11 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.512896205809909 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:29:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:29:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:32 [auto1.fr] INFO: Channel: 24h | Page: 128 | totalHits: 5770 | hits on page: 40
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: GF05733
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: AK36999
2026-03-30 12:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK36999%27 HTTP/1.1" 200 None
2026-03-30 12:29:32 [auto1.fr] INFO: Scrape type for AK36999: 0
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: DA77407
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: BV78883
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: GE65256
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: RS84177
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: BW48684
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: VP49485
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: MW23065
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: KP63735
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: BA73207
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: CJ23217
2026-03-30 12:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ23217%27 HTTP/1.1" 200 None
2026-03-30 12:29:32 [auto1.fr] INFO: Scrape type for CJ23217: 0
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: VU08648
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: CC03519
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: GG92228
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: RR92690
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: SU05446
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: CU55087
2026-03-30 12:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU55087%27 HTTP/1.1" 200 None
2026-03-30 12:29:32 [auto1.fr] INFO: Scrape type for CU55087: 0
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: SM45257
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: EC70489
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: LZ13382
2026-03-30 12:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ13382%27 HTTP/1.1" 200 None
2026-03-30 12:29:32 [auto1.fr] INFO: Scrape type for LZ13382: 0
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: ZF66923
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: KB31607
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: UE67230
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: PH85704
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: YT49094
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: SS17919
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: FH39112
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: KM12499
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: WD51164
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: ED01632
2026-03-30 12:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED01632%27 HTTP/1.1" 200 None
2026-03-30 12:29:32 [auto1.fr] INFO: Scrape type for ED01632: 0
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: BF99335
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: BY36086
2026-03-30 12:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY36086%27 HTTP/1.1" 200 None
2026-03-30 12:29:32 [auto1.fr] INFO: Scrape type for BY36086: 0
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: EJ10392
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: FF80923
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: ZZ56347
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: TW66218
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: LJ63461
2026-03-30 12:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ63461%27 HTTP/1.1" 200 None
2026-03-30 12:29:32 [auto1.fr] INFO: Scrape type for LJ63461: 0
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: HZ59055
2026-03-30 12:29:32 [auto1.fr] INFO: Found listing with ID: DP42522
2026-03-30 12:29:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:33 [auto1.fr] INFO: Channel: 24h | Page: 129 | totalHits: 5770 | hits on page: 40
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: TZ35948
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: ZE01505
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: AZ95773
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: NA91720
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: GR73848
2026-03-30 12:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR73848%27 HTTP/1.1" 200 None
2026-03-30 12:29:33 [auto1.fr] INFO: Scrape type for GR73848: 0
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: DY55554
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: SV47129
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: FY50281
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: XV54294
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: UL61645
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: XP13340
2026-03-30 12:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP13340%27 HTTP/1.1" 200 None
2026-03-30 12:29:33 [auto1.fr] INFO: Scrape type for XP13340: 0
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: WF13879
2026-03-30 12:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF13879%27 HTTP/1.1" 200 None
2026-03-30 12:29:33 [auto1.fr] INFO: Scrape type for WF13879: 0
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: VF42289
2026-03-30 12:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF42289%27 HTTP/1.1" 200 None
2026-03-30 12:29:33 [auto1.fr] INFO: Scrape type for VF42289: 0
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: RC09980
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: FL69972
2026-03-30 12:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL69972%27 HTTP/1.1" 200 None
2026-03-30 12:29:33 [auto1.fr] INFO: Scrape type for FL69972: 0
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: VN32195
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: ES67441
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: AJ90327
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: BK28598
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: BJ48666
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: FN14098
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: RT17592
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: VJ32569
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: YP28351
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: UW75406
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: VA87261
2026-03-30 12:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VA87261%27 HTTP/1.1" 200 None
2026-03-30 12:29:33 [auto1.fr] INFO: Scrape type for VA87261: 0
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: LK58488
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: WT29775
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: NN84576
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: AY57267
2026-03-30 12:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY57267%27 HTTP/1.1" 200 None
2026-03-30 12:29:33 [auto1.fr] INFO: Scrape type for AY57267: 0
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: YM93087
2026-03-30 12:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YM93087%27 HTTP/1.1" 200 None
2026-03-30 12:29:33 [auto1.fr] INFO: Scrape type for YM93087: 0
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: DM85299
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: ZM68465
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: YN12389
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: MN90582
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: DE39656
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: JT40746
2026-03-30 12:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT40746%27 HTTP/1.1" 200 None
2026-03-30 12:29:33 [auto1.fr] INFO: Scrape type for JT40746: 0
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: ER80291
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: HK82247
2026-03-30 12:29:33 [auto1.fr] INFO: Found listing with ID: TV56725
2026-03-30 12:29:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:34 [auto1.fr] INFO: Channel: 24h | Page: 130 | totalHits: 5770 | hits on page: 40
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: SV18797
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: LH87358
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: RG93466
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: MM40591
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: DU54324
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: ZM83363
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: YZ38507
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ38507%27 HTTP/1.1" 200 None
2026-03-30 12:29:34 [auto1.fr] INFO: Scrape type for YZ38507: 0
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: WE18688
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: WS06781
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS06781%27 HTTP/1.1" 200 None
2026-03-30 12:29:34 [auto1.fr] INFO: Scrape type for WS06781: 0
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: AR26119
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: GN11712
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN11712%27 HTTP/1.1" 200 None
2026-03-30 12:29:34 [auto1.fr] INFO: Scrape type for GN11712: 0
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: DJ08565
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: TU11572
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: CY74079
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: KU26111
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: RR42379
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: TD90679
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD90679%27 HTTP/1.1" 200 None
2026-03-30 12:29:34 [auto1.fr] INFO: Scrape type for TD90679: 0
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: JX04019
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: DM88020
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: ZD15255
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: WH98020
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WH98020%27 HTTP/1.1" 200 None
2026-03-30 12:29:34 [auto1.fr] INFO: Scrape type for WH98020: 0
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: LZ40715
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ40715%27 HTTP/1.1" 200 None
2026-03-30 12:29:34 [auto1.fr] INFO: Scrape type for LZ40715: 0
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: PF51870
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: JM55547
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM55547%27 HTTP/1.1" 200 None
2026-03-30 12:29:34 [auto1.fr] INFO: Scrape type for JM55547: 0
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: AP54277
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AP54277%27 HTTP/1.1" 200 None
2026-03-30 12:29:34 [auto1.fr] INFO: Scrape type for AP54277: 0
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: SA90047
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: BE71774
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: LN11414
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: MD09270
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: NB12205
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: JW93608
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW93608%27 HTTP/1.1" 200 None
2026-03-30 12:29:34 [auto1.fr] INFO: Scrape type for JW93608: 0
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: JL64757
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: NS69450
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: RV78912
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: HG76563
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: GS56554
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS56554%27 HTTP/1.1" 200 None
2026-03-30 12:29:34 [auto1.fr] INFO: Scrape type for GS56554: 0
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: AT67197
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: UZ60090
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: PH43807
2026-03-30 12:29:34 [auto1.fr] INFO: Found listing with ID: BS98068
2026-03-30 12:29:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:35 [auto1.fr] INFO: Channel: 24h | Page: 131 | totalHits: 5770 | hits on page: 40
2026-03-30 12:29:35 [auto1.fr] INFO: Found listing with ID: YX43318
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX43318%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.fr] INFO: Scrape type for YX43318: 0
2026-03-30 12:29:35 [auto1.fr] INFO: Found listing with ID: YR64418
2026-03-30 12:29:35 [auto1.fr] INFO: Found listing with ID: MW90901
2026-03-30 12:29:35 [auto1.fr] INFO: Found listing with ID: DA48874
2026-03-30 12:29:35 [auto1.fr] INFO: Found listing with ID: RZ11851
2026-03-30 12:29:35 [auto1.fr] INFO: Found listing with ID: EK91858
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EK91858%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.fr] INFO: Scrape type for EK91858: 0
2026-03-30 12:29:35 [auto1.fr] INFO: Found listing with ID: CG64502
2026-03-30 12:29:35 [auto1.fr] INFO: Found listing with ID: RB41221
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB41221%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.fr] INFO: Scrape type for RB41221: 0
2026-03-30 12:29:35 [auto1.fr] INFO: Found listing with ID: LF48042
2026-03-30 12:29:35 [auto1.fr] INFO: Found listing with ID: RZ78335
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ78335%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.fr] INFO: Scrape type for RZ78335: 0
2026-03-30 12:29:35 [auto1.fr] INFO: Found listing with ID: YP93878
2026-03-30 12:29:35 [auto1.fr] INFO: Found listing with ID: VV72972
2026-03-30 12:29:35 [auto1.fr] INFO: Found listing with ID: WR91711
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR91711%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.fr] INFO: Scrape type for WR91711: 0
2026-03-30 12:29:35 [auto1.fr] INFO: Found listing with ID: MC56053
2026-03-30 12:29:35 [auto1.fr] INFO: Found listing with ID: LJ31009
2026-03-30 12:29:35 [auto1.fr] INFO: Found listing with ID: TU96890
2026-03-30 12:29:35 [auto1.fr] INFO: Found listing with ID: XF13918
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XF13918%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.fr] INFO: Scrape type for XF13918: 0
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: NU85004
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: XG43228
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: VP52788
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: VK76885
2026-03-30 12:29:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK76885%27 HTTP/1.1" 200 None
2026-03-30 12:29:36 [auto1.fr] INFO: Scrape type for VK76885: 0
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: GH44775
2026-03-30 12:29:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GH44775%27 HTTP/1.1" 200 None
2026-03-30 12:29:36 [auto1.fr] INFO: Scrape type for GH44775: 0
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: DR51870
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: CL01176
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: AM10351
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: XT90818
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: VD77755
2026-03-30 12:29:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD77755%27 HTTP/1.1" 200 None
2026-03-30 12:29:36 [auto1.fr] INFO: Scrape type for VD77755: 0
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: DN77795
2026-03-30 12:29:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DN77795%27 HTTP/1.1" 200 None
2026-03-30 12:29:36 [auto1.fr] INFO: Scrape type for DN77795: 0
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: VL29866
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: SC98017
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: GD84029
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: JK56384
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: WW95996
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: VG34464
2026-03-30 12:29:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG34464%27 HTTP/1.1" 200 None
2026-03-30 12:29:36 [auto1.fr] INFO: Scrape type for VG34464: 0
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: TA66955
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: AY56545
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: HD25274
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: DA63430
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: NU90419
2026-03-30 12:29:36 [auto1.fr] INFO: Found listing with ID: HN93768
2026-03-30 12:29:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:37 [auto1.fr] INFO: Channel: 24h | Page: 132 | totalHits: 5770 | hits on page: 40
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: AJ00533
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: MH36333
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: FS45708
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: RB79250
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: GP76636
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: JM10664
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: GW34434
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: ZE29757
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: RU84743
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: FB12489
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: CV00776
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: BP09757
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: DV45059
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: TP83424
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: NM18460
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM18460%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.fr] INFO: Scrape type for NM18460: 0
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: DL49404
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: RL83119
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: SL85731
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL85731%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.fr] INFO: Scrape type for SL85731: 0
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: EP92038
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: SY94548
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: MH79850
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: VV23431
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: NY16315
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: FP74610
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP74610%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.fr] INFO: Scrape type for FP74610: 0
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: TU81935
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: EL18165
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: LW12860
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: MF25679
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF25679%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.fr] INFO: Scrape type for MF25679: 0
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: XC73420
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: BS60880
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: BL36992
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL36992%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.fr] INFO: Scrape type for BL36992: 0
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: JA56665
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: KA38416
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: LG23790
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: MY49274
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: NG63120
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG63120%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.fr] INFO: Scrape type for NG63120: 0
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: YG66833
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: KC34006
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: PL62225
2026-03-30 12:29:37 [auto1.fr] INFO: Found listing with ID: EJ99742
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ99742%27 HTTP/1.1" 200 None
2026-03-30 12:29:37 [auto1.fr] INFO: Scrape type for EJ99742: 0
2026-03-30 12:29:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:39 [auto1.fr] INFO: Channel: 24h | Page: 133 | totalHits: 5770 | hits on page: 40
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: RH54142
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: HL12269
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: BM07810
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: GU57007
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: YR01036
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: MW13165
2026-03-30 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MW13165%27 HTTP/1.1" 200 None
2026-03-30 12:29:39 [auto1.fr] INFO: Scrape type for MW13165: 0
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: AB52956
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: HS30727
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: CJ04169
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: FS74357
2026-03-30 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS74357%27 HTTP/1.1" 200 None
2026-03-30 12:29:39 [auto1.fr] INFO: Scrape type for FS74357: 0
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: PR06479
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: KF87574
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: MT87485
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: JJ33276
2026-03-30 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ33276%27 HTTP/1.1" 200 None
2026-03-30 12:29:39 [auto1.fr] INFO: Scrape type for JJ33276: 0
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: LJ89767
2026-03-30 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ89767%27 HTTP/1.1" 200 None
2026-03-30 12:29:39 [auto1.fr] INFO: Scrape type for LJ89767: 0
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: AE99723
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: KP98552
2026-03-30 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP98552%27 HTTP/1.1" 200 None
2026-03-30 12:29:39 [auto1.fr] INFO: Scrape type for KP98552: 0
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: NY57315
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: YP98531
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: HN87071
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: ZB59125
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: EL36529
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: LP44396
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: LK60696
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: XJ17562
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: RS54085
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: PE49305
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: FU11373
2026-03-30 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU11373%27 HTTP/1.1" 200 None
2026-03-30 12:29:39 [auto1.fr] INFO: Scrape type for FU11373: 0
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: VL29284
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: SM05707
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: WF73144
2026-03-30 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF73144%27 HTTP/1.1" 200 None
2026-03-30 12:29:39 [auto1.fr] INFO: Scrape type for WF73144: 0
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: SK67799
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: KK55948
2026-03-30 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK55948%27 HTTP/1.1" 200 None
2026-03-30 12:29:39 [auto1.fr] INFO: Scrape type for KK55948: 0
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: WG44289
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: GZ17929
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: DR24454
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: XD09782
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: HP11718
2026-03-30 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HP11718%27 HTTP/1.1" 200 None
2026-03-30 12:29:39 [auto1.fr] INFO: Scrape type for HP11718: 0
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: RD57391
2026-03-30 12:29:39 [auto1.fr] INFO: Found listing with ID: BP74967
2026-03-30 12:29:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:41 [auto1.fr] INFO: Channel: 24h | Page: 134 | totalHits: 5770 | hits on page: 40
2026-03-30 12:29:41 [auto1.fr] INFO: Found listing with ID: FX27000
2026-03-30 12:29:41 [auto1.fr] INFO: Found listing with ID: ZG14928
2026-03-30 12:29:41 [auto1.fr] INFO: Found listing with ID: WZ99461
2026-03-30 12:29:41 [auto1.fr] INFO: Found listing with ID: AT48386
2026-03-30 12:29:41 [auto1.fr] INFO: Found listing with ID: LU76278
2026-03-30 12:29:41 [auto1.fr] INFO: Found listing with ID: CZ91297
2026-03-30 12:29:41 [auto1.fr] INFO: Found listing with ID: PE82306
2026-03-30 12:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE82306%27 HTTP/1.1" 200 None
2026-03-30 12:29:41 [auto1.fr] INFO: Scrape type for PE82306: 0
2026-03-30 12:29:41 [auto1.fr] INFO: Found listing with ID: EJ31491
2026-03-30 12:29:41 [auto1.fr] INFO: Found listing with ID: ZL52306
2026-03-30 12:29:41 [auto1.fr] INFO: Found listing with ID: VA88179
2026-03-30 12:29:41 [auto1.fr] INFO: Found listing with ID: LK97185
2026-03-30 12:29:41 [auto1.fr] INFO: Found listing with ID: HH92238
2026-03-30 12:29:41 [auto1.fr] INFO: Found listing with ID: TJ31468
2026-03-30 12:29:41 [auto1.fr] INFO: Found listing with ID: BM18716
2026-03-30 12:29:41 [auto1.fr] INFO: Found listing with ID: LH70344
2026-03-30 12:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH70344%27 HTTP/1.1" 200 None
2026-03-30 12:29:41 [auto1.fr] INFO: Scrape type for LH70344: 2
2026-03-30 12:29:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1086b39-20eb-53fc-9775-8e58eb9a9b65 with identifier: LH70344
2026-03-30 12:29:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1086b39-20eb-53fc-9775-8e58eb9a9b65 with scrape type 2
2026-03-30 12:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1086b39-20eb-53fc-9775-8e58eb9a9b65 with scrape type 2
2026-03-30 12:29:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e1086b39-20eb-53fc-9775-8e58eb9a9b65, identifier: LH70344
2026-03-30 12:29:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e1086b39-20eb-53fc-9775-8e58eb9a9b65 with identifier: LH70344
2026-03-30 12:29:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e1086b39-20eb-53fc-9775-8e58eb9a9b65 with identifier: LH70344
2026-03-30 12:29:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e1086b39-20eb-53fc-9775-8e58eb9a9b65 with identifier: LH70344 to the API
2026-03-30 12:29:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:32:29Z',
'fuel_type': 'petrol',
'id': 'e1086b39-20eb-53fc-9775-8e58eb9a9b65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH70344',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 133202,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-20',
'seller_name': None,
'title': 'Peugeot 3008 1.2 e-THP Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2016}
2026-03-30 12:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH70344%27 HTTP/1.1" 200 None
2026-03-30 12:29:41 [auto1.fr] INFO: Saving data for LH70344: {'auction_closing_time': 1774884749.0, 'created_time': 1774452048.937691, 'last_price_update_time': 1774873781.89301}
2026-03-30 12:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LH70344') HTTP/1.1" 204 0
2026-03-30 12:29:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:41 [auto1.fr] INFO: Found listing with ID: FM12169
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM12169%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.fr] INFO: Scrape type for FM12169: 2
2026-03-30 12:29:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07757702-72d7-5c68-8466-a77bccffa0b7 with identifier: FM12169
2026-03-30 12:29:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07757702-72d7-5c68-8466-a77bccffa0b7 with scrape type 2
2026-03-30 12:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07757702-72d7-5c68-8466-a77bccffa0b7 with scrape type 2
2026-03-30 12:29:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 07757702-72d7-5c68-8466-a77bccffa0b7, identifier: FM12169
2026-03-30 12:29:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 07757702-72d7-5c68-8466-a77bccffa0b7 with identifier: FM12169
2026-03-30 12:29:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 07757702-72d7-5c68-8466-a77bccffa0b7 with identifier: FM12169
2026-03-30 12:29:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 07757702-72d7-5c68-8466-a77bccffa0b7 with identifier: FM12169 to the API
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:38:00Z',
'fuel_type': 'petrol',
'id': '07757702-72d7-5c68-8466-a77bccffa0b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM12169',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII Sportsvan',
'odometer': 159890,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-04',
'seller_name': None,
'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Carat',
'transmission': 'automatic',
'trim': 'Carat',
'year': 2015}
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM12169%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.fr] INFO: Saving data for FM12169: {'auction_closing_time': 1774885080.0, 'created_time': 1774351042.273684, 'last_price_update_time': 1774873782.36972}
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FM12169') HTTP/1.1" 204 0
2026-03-30 12:29:42 [auto1.fr] INFO: Found listing with ID: PR95930
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR95930%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.fr] INFO: Scrape type for PR95930: 0
2026-03-30 12:29:42 [auto1.fr] INFO: Found listing with ID: DZ28866
2026-03-30 12:29:42 [auto1.fr] INFO: Found listing with ID: KH82114
2026-03-30 12:29:42 [auto1.fr] INFO: Found listing with ID: XC71362
2026-03-30 12:29:42 [auto1.fr] INFO: Found listing with ID: WM37539
2026-03-30 12:29:42 [auto1.fr] INFO: Found listing with ID: HE59184
2026-03-30 12:29:42 [auto1.fr] INFO: Found listing with ID: JZ33173
2026-03-30 12:29:42 [auto1.fr] INFO: Found listing with ID: FX42061
2026-03-30 12:29:42 [auto1.fr] INFO: Found listing with ID: NB22660
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NB22660%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.fr] INFO: Scrape type for NB22660: 0
2026-03-30 12:29:42 [auto1.fr] INFO: Found listing with ID: UJ71898
2026-03-30 12:29:42 [auto1.fr] INFO: Found listing with ID: VC88439
2026-03-30 12:29:42 [auto1.fr] INFO: Found listing with ID: EC51722
2026-03-30 12:29:42 [auto1.fr] INFO: Found listing with ID: PP03008
2026-03-30 12:29:42 [auto1.fr] INFO: Found listing with ID: ZJ36902
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ36902%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.fr] INFO: Scrape type for ZJ36902: 0
2026-03-30 12:29:42 [auto1.fr] INFO: Found listing with ID: WY85318
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY85318%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.fr] INFO: Scrape type for WY85318: 2
2026-03-30 12:29:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91f9aa5f-dc2f-563f-a5d3-6e32cff9b6f9 with identifier: WY85318
2026-03-30 12:29:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91f9aa5f-dc2f-563f-a5d3-6e32cff9b6f9 with scrape type 2
2026-03-30 12:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91f9aa5f-dc2f-563f-a5d3-6e32cff9b6f9 with scrape type 2
2026-03-30 12:29:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 91f9aa5f-dc2f-563f-a5d3-6e32cff9b6f9, identifier: WY85318
2026-03-30 12:29:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 91f9aa5f-dc2f-563f-a5d3-6e32cff9b6f9 with identifier: WY85318
2026-03-30 12:29:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 91f9aa5f-dc2f-563f-a5d3-6e32cff9b6f9 with identifier: WY85318
2026-03-30 12:29:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 91f9aa5f-dc2f-563f-a5d3-6e32cff9b6f9 with identifier: WY85318 to the API
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:21:48Z',
'fuel_type': 'petrol',
'id': '91f9aa5f-dc2f-563f-a5d3-6e32cff9b6f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY85318',
'listing': 'auction',
'make': 'Opel',
'model': 'Agila',
'odometer': 126543,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-09-26',
'seller_name': None,
'title': 'Opel Agila 1.2 Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2007}
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY85318%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.fr] INFO: Saving data for WY85318: {'auction_closing_time': 1774884108.0, 'created_time': 1773918558.430861, 'last_price_update_time': 1774873782.806379}
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WY85318') HTTP/1.1" 204 0
2026-03-30 12:29:42 [auto1.fr] INFO: Found listing with ID: ZY20828
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZY20828%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.fr] INFO: Scrape type for ZY20828: 2
2026-03-30 12:29:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcd520aa-5224-5d7f-b3d5-7a63eaec4f9f with identifier: ZY20828
2026-03-30 12:29:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcd520aa-5224-5d7f-b3d5-7a63eaec4f9f with scrape type 2
2026-03-30 12:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcd520aa-5224-5d7f-b3d5-7a63eaec4f9f with scrape type 2
2026-03-30 12:29:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dcd520aa-5224-5d7f-b3d5-7a63eaec4f9f, identifier: ZY20828
2026-03-30 12:29:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dcd520aa-5224-5d7f-b3d5-7a63eaec4f9f with identifier: ZY20828
2026-03-30 12:29:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dcd520aa-5224-5d7f-b3d5-7a63eaec4f9f with identifier: ZY20828
2026-03-30 12:29:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dcd520aa-5224-5d7f-b3d5-7a63eaec4f9f with identifier: ZY20828 to the API
2026-03-30 12:29:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:40:21Z',
'fuel_type': 'diesel',
'id': 'dcd520aa-5224-5d7f-b3d5-7a63eaec4f9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY20828',
'listing': 'auction',
'make': 'Peugeot',
'model': '508',
'odometer': 184319,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-09',
'seller_name': None,
'title': 'Peugeot 508 1.5 Blue-HDi Allure Pack',
'transmission': 'automatic',
'trim': 'Allure Pack',
'year': 2021}
2026-03-30 12:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZY20828%27 HTTP/1.1" 200 None
2026-03-30 12:29:43 [auto1.fr] INFO: Saving data for ZY20828: {'auction_closing_time': 1774885221.0, 'created_time': 1773846487.05172, 'last_price_update_time': 1774873783.337581}
2026-03-30 12:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZY20828') HTTP/1.1" 204 0
2026-03-30 12:29:43 [auto1.fr] INFO: Found listing with ID: US07140
2026-03-30 12:29:43 [auto1.fr] INFO: Found listing with ID: JS42439
2026-03-30 12:29:43 [auto1.fr] INFO: Found listing with ID: PR04216
2026-03-30 12:29:43 [auto1.fr] INFO: Found listing with ID: FN45422
2026-03-30 12:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FN45422%27 HTTP/1.1" 200 None
2026-03-30 12:29:43 [auto1.fr] INFO: Scrape type for FN45422: 2
2026-03-30 12:29:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbea2a80-33c3-5651-b3f6-6a9bdb0705f8 with identifier: FN45422
2026-03-30 12:29:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbea2a80-33c3-5651-b3f6-6a9bdb0705f8 with scrape type 2
2026-03-30 12:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbea2a80-33c3-5651-b3f6-6a9bdb0705f8 with scrape type 2
2026-03-30 12:29:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dbea2a80-33c3-5651-b3f6-6a9bdb0705f8, identifier: FN45422
2026-03-30 12:29:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dbea2a80-33c3-5651-b3f6-6a9bdb0705f8 with identifier: FN45422
2026-03-30 12:29:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dbea2a80-33c3-5651-b3f6-6a9bdb0705f8 with identifier: FN45422
2026-03-30 12:29:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dbea2a80-33c3-5651-b3f6-6a9bdb0705f8 with identifier: FN45422 to the API
2026-03-30 12:29:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:41:57Z',
'fuel_type': 'diesel',
'id': 'dbea2a80-33c3-5651-b3f6-6a9bdb0705f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN45422',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 97830,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-18',
'seller_name': None,
'title': 'Nissan Qashqai 1.5 Turbodiesel N-Connecta',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2019}
2026-03-30 12:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FN45422%27 HTTP/1.1" 200 None
2026-03-30 12:29:43 [auto1.fr] INFO: Saving data for FN45422: {'auction_closing_time': 1774885317.0, 'created_time': 1774696151.385432, 'last_price_update_time': 1774873783.719915}
2026-03-30 12:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FN45422') HTTP/1.1" 204 0
2026-03-30 12:29:43 [auto1.fr] INFO: Found listing with ID: BJ22819
2026-03-30 12:29:43 [auto1.fr] INFO: Found listing with ID: FT37711
2026-03-30 12:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FT37711%27 HTTP/1.1" 200 None
2026-03-30 12:29:43 [auto1.fr] INFO: Scrape type for FT37711: 2
2026-03-30 12:29:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d99b28fc-02b6-59bc-a166-24250b09230b with identifier: FT37711
2026-03-30 12:29:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d99b28fc-02b6-59bc-a166-24250b09230b with scrape type 2
2026-03-30 12:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d99b28fc-02b6-59bc-a166-24250b09230b with scrape type 2
2026-03-30 12:29:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d99b28fc-02b6-59bc-a166-24250b09230b, identifier: FT37711
2026-03-30 12:29:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d99b28fc-02b6-59bc-a166-24250b09230b with identifier: FT37711
2026-03-30 12:29:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d99b28fc-02b6-59bc-a166-24250b09230b with identifier: FT37711
2026-03-30 12:29:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d99b28fc-02b6-59bc-a166-24250b09230b with identifier: FT37711 to the API
2026-03-30 12:29:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 65,
'expiration_date': '2026-03-30T15:34:26Z',
'fuel_type': 'diesel',
'id': 'd99b28fc-02b6-59bc-a166-24250b09230b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT37711',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 248086,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-05-05',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Authentique',
'transmission': 'manual',
'trim': 'Authentique',
'year': 2004}
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FT37711%27 HTTP/1.1" 200 None
2026-03-30 12:29:44 [auto1.fr] INFO: Saving data for FT37711: {'auction_closing_time': 1774884866.0, 'created_time': 1773846364.47683, 'last_price_update_time': 1774873784.09571}
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FT37711') HTTP/1.1" 204 0
2026-03-30 12:29:44 [auto1.fr] INFO: Found listing with ID: SK70239
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK70239%27 HTTP/1.1" 200 None
2026-03-30 12:29:44 [auto1.fr] INFO: Scrape type for SK70239: 0
2026-03-30 12:29:44 [auto1.fr] INFO: Found listing with ID: ZG89376
2026-03-30 12:29:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:45 [auto1.fr] INFO: Channel: 24h | Page: 135 | totalHits: 5770 | hits on page: 40
2026-03-30 12:29:45 [auto1.fr] INFO: Found listing with ID: JW91200
2026-03-30 12:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW91200%27 HTTP/1.1" 200 None
2026-03-30 12:29:45 [auto1.fr] INFO: Scrape type for JW91200: 2
2026-03-30 12:29:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7747efaa-bbcb-5824-b416-c5e03836a937 with identifier: JW91200
2026-03-30 12:29:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7747efaa-bbcb-5824-b416-c5e03836a937 with scrape type 2
2026-03-30 12:29:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7747efaa-bbcb-5824-b416-c5e03836a937 with scrape type 2
2026-03-30 12:29:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7747efaa-bbcb-5824-b416-c5e03836a937, identifier: JW91200
2026-03-30 12:29:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7747efaa-bbcb-5824-b416-c5e03836a937 with identifier: JW91200
2026-03-30 12:29:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7747efaa-bbcb-5824-b416-c5e03836a937 with identifier: JW91200
2026-03-30 12:29:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7747efaa-bbcb-5824-b416-c5e03836a937 with identifier: JW91200 to the API
2026-03-30 12:29:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 241,
'expiration_date': '2026-03-30T15:20:20Z',
'fuel_type': 'diesel',
'id': '7747efaa-bbcb-5824-b416-c5e03836a937',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW91200',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 113086,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-17',
'seller_name': None,
'title': 'Land Rover Evoque D240 Mild-Hybrid R-dynamic HSE',
'transmission': 'automatic',
'trim': 'R-dynamic HSE',
'year': 2020}
2026-03-30 12:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW91200%27 HTTP/1.1" 200 None
2026-03-30 12:29:45 [auto1.fr] INFO: Saving data for JW91200: {'auction_closing_time': 1774884020.0, 'created_time': 1774696316.892822, 'last_price_update_time': 1774873785.462653}
2026-03-30 12:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JW91200') HTTP/1.1" 204 0
2026-03-30 12:29:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:45 [auto1.fr] INFO: Found listing with ID: DR11869
2026-03-30 12:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR11869%27 HTTP/1.1" 200 None
2026-03-30 12:29:45 [auto1.fr] INFO: Scrape type for DR11869: 2
2026-03-30 12:29:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c13476e7-196d-57a5-ae8d-61b77514740c with identifier: DR11869
2026-03-30 12:29:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c13476e7-196d-57a5-ae8d-61b77514740c with scrape type 2
2026-03-30 12:29:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c13476e7-196d-57a5-ae8d-61b77514740c with scrape type 2
2026-03-30 12:29:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c13476e7-196d-57a5-ae8d-61b77514740c, identifier: DR11869
2026-03-30 12:29:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c13476e7-196d-57a5-ae8d-61b77514740c with identifier: DR11869
2026-03-30 12:29:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c13476e7-196d-57a5-ae8d-61b77514740c with identifier: DR11869
2026-03-30 12:29:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c13476e7-196d-57a5-ae8d-61b77514740c with identifier: DR11869 to the API
2026-03-30 12:29:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:48:59Z',
'fuel_type': 'diesel',
'id': 'c13476e7-196d-57a5-ae8d-61b77514740c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR11869',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-15',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.6 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2010}
2026-03-30 12:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR11869%27 HTTP/1.1" 200 None
2026-03-30 12:29:45 [auto1.fr] INFO: Saving data for DR11869: {'auction_closing_time': 1774885739.0, 'created_time': 1774696129.071231, 'last_price_update_time': 1774873785.891651}
2026-03-30 12:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DR11869') HTTP/1.1" 204 0
2026-03-30 12:29:46 [auto1.fr] INFO: Found listing with ID: TJ03842
2026-03-30 12:29:46 [auto1.fr] INFO: Found listing with ID: ZA00928
2026-03-30 12:29:46 [auto1.fr] INFO: Found listing with ID: VS71698
2026-03-30 12:29:46 [auto1.fr] INFO: Found listing with ID: WF90731
2026-03-30 12:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF90731%27 HTTP/1.1" 200 None
2026-03-30 12:29:46 [auto1.fr] INFO: Scrape type for WF90731: 2
2026-03-30 12:29:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44bbb180-0156-577a-a258-8af7c0c426d4 with identifier: WF90731
2026-03-30 12:29:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44bbb180-0156-577a-a258-8af7c0c426d4 with scrape type 2
2026-03-30 12:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44bbb180-0156-577a-a258-8af7c0c426d4 with scrape type 2
2026-03-30 12:29:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 44bbb180-0156-577a-a258-8af7c0c426d4, identifier: WF90731
2026-03-30 12:29:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 44bbb180-0156-577a-a258-8af7c0c426d4 with identifier: WF90731
2026-03-30 12:29:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 44bbb180-0156-577a-a258-8af7c0c426d4 with identifier: WF90731
2026-03-30 12:29:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 44bbb180-0156-577a-a258-8af7c0c426d4 with identifier: WF90731 to the API
2026-03-30 12:29:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:17:14Z',
'fuel_type': 'diesel',
'id': '44bbb180-0156-577a-a258-8af7c0c426d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF90731',
'listing': 'auction',
'make': 'Ford',
'model': 'Ranger',
'odometer': 188011,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-14',
'seller_name': None,
'title': 'Ford Ranger 3.2 TDCi Doppelkabine 4x4 Wildtrak',
'transmission': 'automatic',
'trim': 'Doppelkabine 4x4 Wildtrak',
'year': 2018}
2026-03-30 12:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF90731%27 HTTP/1.1" 200 None
2026-03-30 12:29:46 [auto1.fr] INFO: Saving data for WF90731: {'auction_closing_time': 1774883834.0, 'created_time': 1774696183.095692, 'last_price_update_time': 1774873786.406943}
2026-03-30 12:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WF90731') HTTP/1.1" 204 0
2026-03-30 12:29:46 [auto1.fr] INFO: Found listing with ID: ZG56312
2026-03-30 12:29:46 [auto1.fr] INFO: Found listing with ID: NX15813
2026-03-30 12:29:46 [auto1.fr] INFO: Found listing with ID: WC48174
2026-03-30 12:29:46 [auto1.fr] INFO: Found listing with ID: FE27951
2026-03-30 12:29:46 [auto1.fr] INFO: Found listing with ID: TE34830
2026-03-30 12:29:46 [auto1.fr] INFO: Found listing with ID: NH56939
2026-03-30 12:29:46 [auto1.fr] INFO: Found listing with ID: VU71568
2026-03-30 12:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU71568%27 HTTP/1.1" 200 None
2026-03-30 12:29:46 [auto1.fr] INFO: Scrape type for VU71568: 2
2026-03-30 12:29:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9d75d4a-7227-56d8-a394-b31228b8be9e with identifier: VU71568
2026-03-30 12:29:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9d75d4a-7227-56d8-a394-b31228b8be9e with scrape type 2
2026-03-30 12:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9d75d4a-7227-56d8-a394-b31228b8be9e with scrape type 2
2026-03-30 12:29:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a9d75d4a-7227-56d8-a394-b31228b8be9e, identifier: VU71568
2026-03-30 12:29:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a9d75d4a-7227-56d8-a394-b31228b8be9e with identifier: VU71568
2026-03-30 12:29:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a9d75d4a-7227-56d8-a394-b31228b8be9e with identifier: VU71568
2026-03-30 12:29:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a9d75d4a-7227-56d8-a394-b31228b8be9e with identifier: VU71568 to the API
2026-03-30 12:29:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:22:53Z',
'fuel_type': 'hybrid',
'id': 'a9d75d4a-7227-56d8-a394-b31228b8be9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU71568',
'listing': 'auction',
'make': 'Renault',
'model': 'Arkana',
'odometer': 35707,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-12',
'seller_name': None,
'title': 'Renault Arkana 1.6 Hybrid E-Tech R.S. Line Fast Track',
'transmission': 'automatic',
'trim': 'R.S. Line Fast Track',
'year': 2022}
2026-03-30 12:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU71568%27 HTTP/1.1" 200 None
2026-03-30 12:29:46 [auto1.fr] INFO: Saving data for VU71568: {'auction_closing_time': 1774884173.0, 'created_time': 1774696139.12129, 'last_price_update_time': 1774873786.818117}
2026-03-30 12:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VU71568') HTTP/1.1" 204 0
2026-03-30 12:29:46 [auto1.fr] INFO: Found listing with ID: BC68382
2026-03-30 12:29:46 [auto1.fr] INFO: Found listing with ID: LL89044
2026-03-30 12:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL89044%27 HTTP/1.1" 200 None
2026-03-30 12:29:46 [auto1.fr] INFO: Scrape type for LL89044: 2
2026-03-30 12:29:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4b58f1b-b616-5642-9717-eb5ae91cac34 with identifier: LL89044
2026-03-30 12:29:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4b58f1b-b616-5642-9717-eb5ae91cac34 with scrape type 2
2026-03-30 12:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4b58f1b-b616-5642-9717-eb5ae91cac34 with scrape type 2
2026-03-30 12:29:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a4b58f1b-b616-5642-9717-eb5ae91cac34, identifier: LL89044
2026-03-30 12:29:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a4b58f1b-b616-5642-9717-eb5ae91cac34 with identifier: LL89044
2026-03-30 12:29:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a4b58f1b-b616-5642-9717-eb5ae91cac34 with identifier: LL89044
2026-03-30 12:29:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a4b58f1b-b616-5642-9717-eb5ae91cac34 with identifier: LL89044 to the API
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:42:40Z',
'fuel_type': 'diesel',
'id': 'a4b58f1b-b616-5642-9717-eb5ae91cac34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL89044',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 106886,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-16',
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2018}
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL89044%27 HTTP/1.1" 200 None
2026-03-30 12:29:47 [auto1.fr] INFO: Saving data for LL89044: {'auction_closing_time': 1774885360.0, 'created_time': 1774696097.939567, 'last_price_update_time': 1774873787.336748}
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LL89044') HTTP/1.1" 204 0
2026-03-30 12:29:47 [auto1.fr] INFO: Found listing with ID: NG74771
2026-03-30 12:29:47 [auto1.fr] INFO: Found listing with ID: AZ39616
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ39616%27 HTTP/1.1" 200 None
2026-03-30 12:29:47 [auto1.fr] INFO: Scrape type for AZ39616: 2
2026-03-30 12:29:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 376ec1a3-9057-5064-a025-fe2f1f377641 with identifier: AZ39616
2026-03-30 12:29:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 376ec1a3-9057-5064-a025-fe2f1f377641 with scrape type 2
2026-03-30 12:29:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 376ec1a3-9057-5064-a025-fe2f1f377641 with scrape type 2
2026-03-30 12:29:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 376ec1a3-9057-5064-a025-fe2f1f377641, identifier: AZ39616
2026-03-30 12:29:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 376ec1a3-9057-5064-a025-fe2f1f377641 with identifier: AZ39616
2026-03-30 12:29:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 376ec1a3-9057-5064-a025-fe2f1f377641 with identifier: AZ39616
2026-03-30 12:29:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 376ec1a3-9057-5064-a025-fe2f1f377641 with identifier: AZ39616 to the API
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:25:32Z',
'fuel_type': 'diesel',
'id': '376ec1a3-9057-5064-a025-fe2f1f377641',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ39616',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra GTC',
'odometer': 213082,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-01',
'seller_name': None,
'title': 'Opel Astra GTC 1.3 CDTI Essentia',
'transmission': 'manual',
'trim': 'Essentia',
'year': 2009}
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ39616%27 HTTP/1.1" 200 None
2026-03-30 12:29:47 [auto1.fr] INFO: Saving data for AZ39616: {'auction_closing_time': 1774884332.0, 'created_time': 1774696070.530741, 'last_price_update_time': 1774873787.729491}
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AZ39616') HTTP/1.1" 204 0
2026-03-30 12:29:47 [auto1.fr] INFO: Found listing with ID: XT35695
2026-03-30 12:29:47 [auto1.fr] INFO: Found listing with ID: RD15747
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD15747%27 HTTP/1.1" 200 None
2026-03-30 12:29:47 [auto1.fr] INFO: Scrape type for RD15747: 2
2026-03-30 12:29:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 585c1c4a-e718-5abf-be93-b423889f58a0 with identifier: RD15747
2026-03-30 12:29:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 585c1c4a-e718-5abf-be93-b423889f58a0 with scrape type 2
2026-03-30 12:29:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 585c1c4a-e718-5abf-be93-b423889f58a0 with scrape type 2
2026-03-30 12:29:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 585c1c4a-e718-5abf-be93-b423889f58a0, identifier: RD15747
2026-03-30 12:29:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 585c1c4a-e718-5abf-be93-b423889f58a0 with identifier: RD15747
2026-03-30 12:29:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 585c1c4a-e718-5abf-be93-b423889f58a0 with identifier: RD15747
2026-03-30 12:29:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 585c1c4a-e718-5abf-be93-b423889f58a0 with identifier: RD15747 to the API
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:47:02Z',
'fuel_type': 'petrol',
'id': '585c1c4a-e718-5abf-be93-b423889f58a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD15747',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 32479,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-03',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2023}
2026-03-30 12:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD15747%27 HTTP/1.1" 200 None
2026-03-30 12:29:48 [auto1.fr] INFO: Saving data for RD15747: {'auction_closing_time': 1774885622.0, 'created_time': 1774696207.536872, 'last_price_update_time': 1774873788.11511}
2026-03-30 12:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RD15747') HTTP/1.1" 204 0
2026-03-30 12:29:48 [auto1.fr] INFO: Found listing with ID: KF17050
2026-03-30 12:29:48 [auto1.fr] INFO: Found listing with ID: VS38461
2026-03-30 12:29:48 [auto1.fr] INFO: Found listing with ID: VY77221
2026-03-30 12:29:48 [auto1.fr] INFO: Found listing with ID: JH19113
2026-03-30 12:29:48 [auto1.fr] INFO: Found listing with ID: KP99066
2026-03-30 12:29:48 [auto1.fr] INFO: Found listing with ID: MP27758
2026-03-30 12:29:48 [auto1.fr] INFO: Found listing with ID: BD79796
2026-03-30 12:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD79796%27 HTTP/1.1" 200 None
2026-03-30 12:29:48 [auto1.fr] INFO: Scrape type for BD79796: 2
2026-03-30 12:29:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b81e3fd-32fa-55aa-8ad9-738466d07a61 with identifier: BD79796
2026-03-30 12:29:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b81e3fd-32fa-55aa-8ad9-738466d07a61 with scrape type 2
2026-03-30 12:29:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b81e3fd-32fa-55aa-8ad9-738466d07a61 with scrape type 2
2026-03-30 12:29:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5b81e3fd-32fa-55aa-8ad9-738466d07a61, identifier: BD79796
2026-03-30 12:29:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5b81e3fd-32fa-55aa-8ad9-738466d07a61 with identifier: BD79796
2026-03-30 12:29:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5b81e3fd-32fa-55aa-8ad9-738466d07a61 with identifier: BD79796
2026-03-30 12:29:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5b81e3fd-32fa-55aa-8ad9-738466d07a61 with identifier: BD79796 to the API
2026-03-30 12:29:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:17:16Z',
'fuel_type': 'diesel',
'id': '5b81e3fd-32fa-55aa-8ad9-738466d07a61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD79796',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 129001,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-31',
'seller_name': None,
'title': 'BMW X1 sDrive 18d Premiere',
'transmission': 'manual',
'trim': 'Premiere',
'year': 2012}
2026-03-30 12:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD79796%27 HTTP/1.1" 200 None
2026-03-30 12:29:48 [auto1.fr] INFO: Saving data for BD79796: {'auction_closing_time': 1774883836.0, 'created_time': 1772777034.779085, 'last_price_update_time': 1774873788.497704}
2026-03-30 12:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BD79796') HTTP/1.1" 204 0
2026-03-30 12:29:48 [auto1.fr] INFO: Found listing with ID: DL40614
2026-03-30 12:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL40614%27 HTTP/1.1" 200 None
2026-03-30 12:29:48 [auto1.fr] INFO: Scrape type for DL40614: 2
2026-03-30 12:29:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa3c5062-87fd-52e2-8100-08e51fd00404 with identifier: DL40614
2026-03-30 12:29:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa3c5062-87fd-52e2-8100-08e51fd00404 with scrape type 2
2026-03-30 12:29:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa3c5062-87fd-52e2-8100-08e51fd00404 with scrape type 2
2026-03-30 12:29:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fa3c5062-87fd-52e2-8100-08e51fd00404, identifier: DL40614
2026-03-30 12:29:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fa3c5062-87fd-52e2-8100-08e51fd00404 with identifier: DL40614
2026-03-30 12:29:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fa3c5062-87fd-52e2-8100-08e51fd00404 with identifier: DL40614
2026-03-30 12:29:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fa3c5062-87fd-52e2-8100-08e51fd00404 with identifier: DL40614 to the API
2026-03-30 12:29:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:19:57Z',
'fuel_type': 'diesel',
'id': 'fa3c5062-87fd-52e2-8100-08e51fd00404',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL40614',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 202817,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-19',
'seller_name': None,
'title': 'Renault Kadjar 1.5 dCi Energy Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2015}
2026-03-30 12:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL40614%27 HTTP/1.1" 200 None
2026-03-30 12:29:48 [auto1.fr] INFO: Saving data for DL40614: {'auction_closing_time': 1774883997.0, 'created_time': 1774696188.233106, 'last_price_update_time': 1774873788.995748}
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DL40614') HTTP/1.1" 204 0
2026-03-30 12:29:49 [auto1.fr] INFO: Found listing with ID: AC74859
2026-03-30 12:29:49 [auto1.fr] INFO: Found listing with ID: AW34513
2026-03-30 12:29:49 [auto1.fr] INFO: Found listing with ID: DG82856
2026-03-30 12:29:49 [auto1.fr] INFO: Found listing with ID: KN45042
2026-03-30 12:29:49 [auto1.fr] INFO: Found listing with ID: EU39800
2026-03-30 12:29:49 [auto1.fr] INFO: Found listing with ID: JX82453
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX82453%27 HTTP/1.1" 200 None
2026-03-30 12:29:49 [auto1.fr] INFO: Scrape type for JX82453: 2
2026-03-30 12:29:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bd8926b-7219-5db1-a466-c33ee2969395 with identifier: JX82453
2026-03-30 12:29:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bd8926b-7219-5db1-a466-c33ee2969395 with scrape type 2
2026-03-30 12:29:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bd8926b-7219-5db1-a466-c33ee2969395 with scrape type 2
2026-03-30 12:29:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1bd8926b-7219-5db1-a466-c33ee2969395, identifier: JX82453
2026-03-30 12:29:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1bd8926b-7219-5db1-a466-c33ee2969395 with identifier: JX82453
2026-03-30 12:29:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1bd8926b-7219-5db1-a466-c33ee2969395 with identifier: JX82453
2026-03-30 12:29:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1bd8926b-7219-5db1-a466-c33ee2969395 with identifier: JX82453 to the API
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:03:05Z',
'fuel_type': 'diesel',
'id': '1bd8926b-7219-5db1-a466-c33ee2969395',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX82453',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 177691,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-25',
'seller_name': None,
'title': 'Peugeot 3008 1.6 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2017}
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX82453%27 HTTP/1.1" 200 None
2026-03-30 12:29:49 [auto1.fr] INFO: Saving data for JX82453: {'auction_closing_time': 1774882985.0, 'created_time': 1774015502.819825, 'last_price_update_time': 1774873789.373028}
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JX82453') HTTP/1.1" 204 0
2026-03-30 12:29:49 [auto1.fr] INFO: Found listing with ID: SV10039
2026-03-30 12:29:49 [auto1.fr] INFO: Found listing with ID: BX05751
2026-03-30 12:29:49 [auto1.fr] INFO: Found listing with ID: JA99192
2026-03-30 12:29:49 [auto1.fr] INFO: Found listing with ID: PZ06950
2026-03-30 12:29:49 [auto1.fr] INFO: Found listing with ID: TU12769
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU12769%27 HTTP/1.1" 200 None
2026-03-30 12:29:49 [auto1.fr] INFO: Scrape type for TU12769: 2
2026-03-30 12:29:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50ac4f20-bbb0-5477-8952-3cd7c0fac575 with identifier: TU12769
2026-03-30 12:29:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50ac4f20-bbb0-5477-8952-3cd7c0fac575 with scrape type 2
2026-03-30 12:29:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50ac4f20-bbb0-5477-8952-3cd7c0fac575 with scrape type 2
2026-03-30 12:29:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 50ac4f20-bbb0-5477-8952-3cd7c0fac575, identifier: TU12769
2026-03-30 12:29:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 50ac4f20-bbb0-5477-8952-3cd7c0fac575 with identifier: TU12769
2026-03-30 12:29:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 50ac4f20-bbb0-5477-8952-3cd7c0fac575 with identifier: TU12769
2026-03-30 12:29:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 50ac4f20-bbb0-5477-8952-3cd7c0fac575 with identifier: TU12769 to the API
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:28:46Z',
'fuel_type': 'diesel',
'id': '50ac4f20-bbb0-5477-8952-3cd7c0fac575',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU12769',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 183722,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-14',
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2015}
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU12769%27 HTTP/1.1" 200 None
2026-03-30 12:29:49 [auto1.fr] INFO: Saving data for TU12769: {'auction_closing_time': 1774884526.0, 'created_time': 1772886637.372509, 'last_price_update_time': 1774873789.782861}
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TU12769') HTTP/1.1" 204 0
2026-03-30 12:29:49 [auto1.fr] INFO: Found listing with ID: PE26922
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE26922%27 HTTP/1.1" 200 None
2026-03-30 12:29:49 [auto1.fr] INFO: Scrape type for PE26922: 2
2026-03-30 12:29:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbc394ad-38f6-5fd2-bebe-b87523f0a934 with identifier: PE26922
2026-03-30 12:29:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbc394ad-38f6-5fd2-bebe-b87523f0a934 with scrape type 2
2026-03-30 12:29:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbc394ad-38f6-5fd2-bebe-b87523f0a934 with scrape type 2
2026-03-30 12:29:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cbc394ad-38f6-5fd2-bebe-b87523f0a934, identifier: PE26922
2026-03-30 12:29:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cbc394ad-38f6-5fd2-bebe-b87523f0a934 with identifier: PE26922
2026-03-30 12:29:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cbc394ad-38f6-5fd2-bebe-b87523f0a934 with identifier: PE26922
2026-03-30 12:29:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cbc394ad-38f6-5fd2-bebe-b87523f0a934 with identifier: PE26922 to the API
2026-03-30 12:29:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:28:15Z',
'fuel_type': 'diesel',
'id': 'cbc394ad-38f6-5fd2-bebe-b87523f0a934',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE26922',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 134018,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-29',
'seller_name': None,
'title': 'Kia Sportage 1.7 CRDi Active 2WD',
'transmission': 'manual',
'trim': 'Active 2WD',
'year': 2017}
2026-03-30 12:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE26922%27 HTTP/1.1" 200 None
2026-03-30 12:29:50 [auto1.fr] INFO: Saving data for PE26922: {'auction_closing_time': 1774884495.0, 'created_time': 1774696083.661147, 'last_price_update_time': 1774873790.294915}
2026-03-30 12:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PE26922') HTTP/1.1" 204 0
2026-03-30 12:29:50 [auto1.fr] INFO: Found listing with ID: BB96463
2026-03-30 12:29:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:54 [auto1.fr] INFO: Channel: 24h | Page: 136 | totalHits: 5770 | hits on page: 40
2026-03-30 12:29:54 [auto1.fr] INFO: Found listing with ID: UT65590
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT65590%27 HTTP/1.1" 200 None
2026-03-30 12:29:54 [auto1.fr] INFO: Scrape type for UT65590: 2
2026-03-30 12:29:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc10faf8-bc22-5224-9b37-b6ef5e75384a with identifier: UT65590
2026-03-30 12:29:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc10faf8-bc22-5224-9b37-b6ef5e75384a with scrape type 2
2026-03-30 12:29:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc10faf8-bc22-5224-9b37-b6ef5e75384a with scrape type 2
2026-03-30 12:29:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fc10faf8-bc22-5224-9b37-b6ef5e75384a, identifier: UT65590
2026-03-30 12:29:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fc10faf8-bc22-5224-9b37-b6ef5e75384a with identifier: UT65590
2026-03-30 12:29:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fc10faf8-bc22-5224-9b37-b6ef5e75384a with identifier: UT65590
2026-03-30 12:29:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fc10faf8-bc22-5224-9b37-b6ef5e75384a with identifier: UT65590 to the API
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:48:31Z',
'fuel_type': 'diesel',
'id': 'fc10faf8-bc22-5224-9b37-b6ef5e75384a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT65590',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 191340,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-22',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2014}
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT65590%27 HTTP/1.1" 200 None
2026-03-30 12:29:54 [auto1.fr] INFO: Saving data for UT65590: {'auction_closing_time': 1774885711.0, 'created_time': 1774696086.343402, 'last_price_update_time': 1774873794.85046}
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UT65590') HTTP/1.1" 204 0
2026-03-30 12:29:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:54 [auto1.fr] INFO: Found listing with ID: TR59286
2026-03-30 12:29:54 [auto1.fr] INFO: Found listing with ID: JY96027
2026-03-30 12:29:54 [auto1.fr] INFO: Found listing with ID: WX21157
2026-03-30 12:29:54 [auto1.fr] INFO: Found listing with ID: XK45019
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK45019%27 HTTP/1.1" 200 None
2026-03-30 12:29:54 [auto1.fr] INFO: Scrape type for XK45019: 2
2026-03-30 12:29:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f03a3ddb-bab5-50ab-a677-ccf865de9fcd with identifier: XK45019
2026-03-30 12:29:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f03a3ddb-bab5-50ab-a677-ccf865de9fcd with scrape type 2
2026-03-30 12:29:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f03a3ddb-bab5-50ab-a677-ccf865de9fcd with scrape type 2
2026-03-30 12:29:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f03a3ddb-bab5-50ab-a677-ccf865de9fcd, identifier: XK45019
2026-03-30 12:29:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f03a3ddb-bab5-50ab-a677-ccf865de9fcd with identifier: XK45019
2026-03-30 12:29:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f03a3ddb-bab5-50ab-a677-ccf865de9fcd with identifier: XK45019
2026-03-30 12:29:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f03a3ddb-bab5-50ab-a677-ccf865de9fcd with identifier: XK45019 to the API
2026-03-30 12:29:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:40:36Z',
'fuel_type': 'diesel',
'id': 'f03a3ddb-bab5-50ab-a677-ccf865de9fcd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK45019',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 346044,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-15',
'seller_name': None,
'title': 'BMW 3er 330d xDrive Sport Design',
'transmission': 'automatic',
'trim': 'xDrive Sport Design',
'year': 2010}
2026-03-30 12:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK45019%27 HTTP/1.1" 200 None
2026-03-30 12:29:55 [auto1.fr] INFO: Saving data for XK45019: {'auction_closing_time': 1774885236.0, 'created_time': 1774696324.24665, 'last_price_update_time': 1774873795.347392}
2026-03-30 12:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XK45019') HTTP/1.1" 204 0
2026-03-30 12:29:55 [auto1.fr] INFO: Found listing with ID: LX46107
2026-03-30 12:29:55 [auto1.fr] INFO: Found listing with ID: EA97612
2026-03-30 12:29:55 [auto1.fr] INFO: Found listing with ID: JB58313
2026-03-30 12:29:55 [auto1.fr] INFO: Found listing with ID: DL20773
2026-03-30 12:29:55 [auto1.fr] INFO: Found listing with ID: VP29184
2026-03-30 12:29:55 [auto1.fr] INFO: Found listing with ID: PV60309
2026-03-30 12:29:55 [auto1.fr] INFO: Found listing with ID: AD33709
2026-03-30 12:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD33709%27 HTTP/1.1" 200 None
2026-03-30 12:29:55 [auto1.fr] INFO: Scrape type for AD33709: 2
2026-03-30 12:29:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfa07710-8f89-5550-8bec-21b0bd3b0392 with identifier: AD33709
2026-03-30 12:29:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfa07710-8f89-5550-8bec-21b0bd3b0392 with scrape type 2
2026-03-30 12:29:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfa07710-8f89-5550-8bec-21b0bd3b0392 with scrape type 2
2026-03-30 12:29:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dfa07710-8f89-5550-8bec-21b0bd3b0392, identifier: AD33709
2026-03-30 12:29:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dfa07710-8f89-5550-8bec-21b0bd3b0392 with identifier: AD33709
2026-03-30 12:29:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dfa07710-8f89-5550-8bec-21b0bd3b0392 with identifier: AD33709
2026-03-30 12:29:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dfa07710-8f89-5550-8bec-21b0bd3b0392 with identifier: AD33709 to the API
2026-03-30 12:29:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:16:45Z',
'fuel_type': 'petrol',
'id': 'dfa07710-8f89-5550-8bec-21b0bd3b0392',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD33709',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 65616,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-14',
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2019}
2026-03-30 12:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD33709%27 HTTP/1.1" 200 None
2026-03-30 12:29:55 [auto1.fr] INFO: Saving data for AD33709: {'auction_closing_time': 1774883805.0, 'created_time': 1774696331.856738, 'last_price_update_time': 1774873795.841459}
2026-03-30 12:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AD33709') HTTP/1.1" 204 0
2026-03-30 12:29:55 [auto1.fr] INFO: Found listing with ID: RM96136
2026-03-30 12:29:55 [auto1.fr] INFO: Found listing with ID: BV64687
2026-03-30 12:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV64687%27 HTTP/1.1" 200 None
2026-03-30 12:29:55 [auto1.fr] INFO: Scrape type for BV64687: 2
2026-03-30 12:29:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8789ac9-3e12-52b8-9719-1a78c0f3b3b2 with identifier: BV64687
2026-03-30 12:29:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8789ac9-3e12-52b8-9719-1a78c0f3b3b2 with scrape type 2
2026-03-30 12:29:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8789ac9-3e12-52b8-9719-1a78c0f3b3b2 with scrape type 2
2026-03-30 12:29:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c8789ac9-3e12-52b8-9719-1a78c0f3b3b2, identifier: BV64687
2026-03-30 12:29:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c8789ac9-3e12-52b8-9719-1a78c0f3b3b2 with identifier: BV64687
2026-03-30 12:29:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c8789ac9-3e12-52b8-9719-1a78c0f3b3b2 with identifier: BV64687
2026-03-30 12:29:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c8789ac9-3e12-52b8-9719-1a78c0f3b3b2 with identifier: BV64687 to the API
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:14:24Z',
'fuel_type': 'diesel',
'id': 'c8789ac9-3e12-52b8-9719-1a78c0f3b3b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV64687',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 250135,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-11-03',
'seller_name': None,
'title': 'Audi A6 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV64687%27 HTTP/1.1" 200 None
2026-03-30 12:29:56 [auto1.fr] INFO: Saving data for BV64687: {'auction_closing_time': 1774883664.0, 'created_time': 1774696358.665532, 'last_price_update_time': 1774873796.531777}
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BV64687') HTTP/1.1" 204 0
2026-03-30 12:29:56 [auto1.fr] INFO: Found listing with ID: SK88596
2026-03-30 12:29:56 [auto1.fr] INFO: Found listing with ID: HZ74306
2026-03-30 12:29:56 [auto1.fr] INFO: Found listing with ID: CD77238
2026-03-30 12:29:56 [auto1.fr] INFO: Found listing with ID: KZ89285
2026-03-30 12:29:56 [auto1.fr] INFO: Found listing with ID: WX01011
2026-03-30 12:29:56 [auto1.fr] INFO: Found listing with ID: YD32595
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YD32595%27 HTTP/1.1" 200 None
2026-03-30 12:29:56 [auto1.fr] INFO: Scrape type for YD32595: 2
2026-03-30 12:29:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c94dbdb1-5190-571b-bc6c-0ed08ba153cf with identifier: YD32595
2026-03-30 12:29:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c94dbdb1-5190-571b-bc6c-0ed08ba153cf with scrape type 2
2026-03-30 12:29:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c94dbdb1-5190-571b-bc6c-0ed08ba153cf with scrape type 2
2026-03-30 12:29:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c94dbdb1-5190-571b-bc6c-0ed08ba153cf, identifier: YD32595
2026-03-30 12:29:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c94dbdb1-5190-571b-bc6c-0ed08ba153cf with identifier: YD32595
2026-03-30 12:29:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c94dbdb1-5190-571b-bc6c-0ed08ba153cf with identifier: YD32595
2026-03-30 12:29:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c94dbdb1-5190-571b-bc6c-0ed08ba153cf with identifier: YD32595 to the API
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:31:15Z',
'fuel_type': 'diesel',
'id': 'c94dbdb1-5190-571b-bc6c-0ed08ba153cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD32595',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 123623,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-16',
'seller_name': None,
'title': 'Peugeot 308 1.5 Blue-HDi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2019}
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YD32595%27 HTTP/1.1" 200 None
2026-03-30 12:29:57 [auto1.fr] INFO: Saving data for YD32595: {'auction_closing_time': 1774884675.0, 'created_time': 1774696269.164852, 'last_price_update_time': 1774873797.034916}
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YD32595') HTTP/1.1" 204 0
2026-03-30 12:29:57 [auto1.fr] INFO: Found listing with ID: KC15476
2026-03-30 12:29:57 [auto1.fr] INFO: Found listing with ID: GU05204
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU05204%27 HTTP/1.1" 200 None
2026-03-30 12:29:57 [auto1.fr] INFO: Scrape type for GU05204: 2
2026-03-30 12:29:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e0ef807-45f8-5aa8-9d35-d6cb17b7523e with identifier: GU05204
2026-03-30 12:29:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e0ef807-45f8-5aa8-9d35-d6cb17b7523e with scrape type 2
2026-03-30 12:29:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e0ef807-45f8-5aa8-9d35-d6cb17b7523e with scrape type 2
2026-03-30 12:29:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0e0ef807-45f8-5aa8-9d35-d6cb17b7523e, identifier: GU05204
2026-03-30 12:29:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0e0ef807-45f8-5aa8-9d35-d6cb17b7523e with identifier: GU05204
2026-03-30 12:29:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0e0ef807-45f8-5aa8-9d35-d6cb17b7523e with identifier: GU05204
2026-03-30 12:29:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0e0ef807-45f8-5aa8-9d35-d6cb17b7523e with identifier: GU05204 to the API
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:15:34Z',
'fuel_type': 'diesel',
'id': '0e0ef807-45f8-5aa8-9d35-d6cb17b7523e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU05204',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 143939,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-26',
'seller_name': None,
'title': 'Audi A4 35 TDI Mild-Hybrid Design',
'transmission': 'automatic',
'trim': 'Design',
'year': 2020}
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU05204%27 HTTP/1.1" 200 None
2026-03-30 12:29:57 [auto1.fr] INFO: Saving data for GU05204: {'auction_closing_time': 1774883734.0, 'created_time': 1774696258.834564, 'last_price_update_time': 1774873797.560314}
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GU05204') HTTP/1.1" 204 0
2026-03-30 12:29:57 [auto1.fr] INFO: Found listing with ID: RE43967
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE43967%27 HTTP/1.1" 200 None
2026-03-30 12:29:57 [auto1.fr] INFO: Scrape type for RE43967: 2
2026-03-30 12:29:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5c6539c-885c-5e8c-9456-aec0dda8e0aa with identifier: RE43967
2026-03-30 12:29:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5c6539c-885c-5e8c-9456-aec0dda8e0aa with scrape type 2
2026-03-30 12:29:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5c6539c-885c-5e8c-9456-aec0dda8e0aa with scrape type 2
2026-03-30 12:29:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d5c6539c-885c-5e8c-9456-aec0dda8e0aa, identifier: RE43967
2026-03-30 12:29:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d5c6539c-885c-5e8c-9456-aec0dda8e0aa with identifier: RE43967
2026-03-30 12:29:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d5c6539c-885c-5e8c-9456-aec0dda8e0aa with identifier: RE43967
2026-03-30 12:29:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d5c6539c-885c-5e8c-9456-aec0dda8e0aa with identifier: RE43967 to the API
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:34:32Z',
'fuel_type': 'petrol',
'id': 'd5c6539c-885c-5e8c-9456-aec0dda8e0aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE43967',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 126510,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-12',
'seller_name': None,
'title': 'Nissan Juke 1.2 N-tec',
'transmission': 'manual',
'trim': 'N-tec',
'year': 2014}
2026-03-30 12:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE43967%27 HTTP/1.1" 200 None
2026-03-30 12:29:58 [auto1.fr] INFO: Saving data for RE43967: {'auction_closing_time': 1774884872.0, 'created_time': 1774696238.750983, 'last_price_update_time': 1774873798.041872}
2026-03-30 12:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RE43967') HTTP/1.1" 204 0
2026-03-30 12:29:58 [auto1.fr] INFO: Found listing with ID: KA57472
2026-03-30 12:29:58 [auto1.fr] INFO: Found listing with ID: BG08917
2026-03-30 12:29:58 [auto1.fr] INFO: Found listing with ID: PT14342
2026-03-30 12:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PT14342%27 HTTP/1.1" 200 None
2026-03-30 12:29:58 [auto1.fr] INFO: Scrape type for PT14342: 2
2026-03-30 12:29:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea6c9a82-efd3-57e1-bee9-f972e4b6c165 with identifier: PT14342
2026-03-30 12:29:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea6c9a82-efd3-57e1-bee9-f972e4b6c165 with scrape type 2
2026-03-30 12:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea6c9a82-efd3-57e1-bee9-f972e4b6c165 with scrape type 2
2026-03-30 12:29:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ea6c9a82-efd3-57e1-bee9-f972e4b6c165, identifier: PT14342
2026-03-30 12:29:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ea6c9a82-efd3-57e1-bee9-f972e4b6c165 with identifier: PT14342
2026-03-30 12:29:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ea6c9a82-efd3-57e1-bee9-f972e4b6c165 with identifier: PT14342
2026-03-30 12:29:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ea6c9a82-efd3-57e1-bee9-f972e4b6c165 with identifier: PT14342 to the API
2026-03-30 12:29:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:45:26Z',
'fuel_type': 'petrol',
'id': 'ea6c9a82-efd3-57e1-bee9-f972e4b6c165',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT14342',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 96263,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-10',
'seller_name': None,
'title': 'Renault Clio 1.0 TCe Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2019}
2026-03-30 12:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PT14342%27 HTTP/1.1" 200 None
2026-03-30 12:29:58 [auto1.fr] INFO: Saving data for PT14342: {'auction_closing_time': 1774885526.0, 'created_time': 1774696312.67563, 'last_price_update_time': 1774873798.736336}
2026-03-30 12:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PT14342') HTTP/1.1" 204 0
2026-03-30 12:29:58 [auto1.fr] INFO: Found listing with ID: GY90966
2026-03-30 12:29:58 [auto1.fr] INFO: Found listing with ID: UC79698
2026-03-30 12:29:58 [auto1.fr] INFO: Found listing with ID: GM38223
2026-03-30 12:29:58 [auto1.fr] INFO: Found listing with ID: YC54158
2026-03-30 12:29:58 [auto1.fr] INFO: Found listing with ID: GG25713
2026-03-30 12:29:58 [auto1.fr] INFO: Found listing with ID: CY58492
2026-03-30 12:29:58 [auto1.fr] INFO: Found listing with ID: CE19046
2026-03-30 12:29:58 [auto1.fr] INFO: Found listing with ID: UW04055
2026-03-30 12:29:58 [auto1.fr] INFO: Found listing with ID: KA52322
2026-03-30 12:29:58 [auto1.fr] INFO: Found listing with ID: KD86266
2026-03-30 12:29:58 [auto1.fr] INFO: Found listing with ID: WD98248
2026-03-30 12:29:58 [auto1.fr] INFO: Found listing with ID: VK64881
2026-03-30 12:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK64881%27 HTTP/1.1" 200 None
2026-03-30 12:29:58 [auto1.fr] INFO: Scrape type for VK64881: 2
2026-03-30 12:29:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e1efc3a-a573-5308-9825-915c1a6f9ad8 with identifier: VK64881
2026-03-30 12:29:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e1efc3a-a573-5308-9825-915c1a6f9ad8 with scrape type 2
2026-03-30 12:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e1efc3a-a573-5308-9825-915c1a6f9ad8 with scrape type 2
2026-03-30 12:29:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4e1efc3a-a573-5308-9825-915c1a6f9ad8, identifier: VK64881
2026-03-30 12:29:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4e1efc3a-a573-5308-9825-915c1a6f9ad8 with identifier: VK64881
2026-03-30 12:29:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4e1efc3a-a573-5308-9825-915c1a6f9ad8 with identifier: VK64881
2026-03-30 12:29:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4e1efc3a-a573-5308-9825-915c1a6f9ad8 with identifier: VK64881 to the API
2026-03-30 12:29:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:14:35Z',
'fuel_type': 'petrol',
'id': '4e1efc3a-a573-5308-9825-915c1a6f9ad8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK64881',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 90728,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-07',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2018}
2026-03-30 12:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK64881%27 HTTP/1.1" 200 None
2026-03-30 12:29:59 [auto1.fr] INFO: Saving data for VK64881: {'auction_closing_time': 1774883675.0, 'created_time': 1774696196.124553, 'last_price_update_time': 1774873799.240215}
2026-03-30 12:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VK64881') HTTP/1.1" 204 0
2026-03-30 12:29:59 [auto1.fr] INFO: Found listing with ID: EU67492
2026-03-30 12:29:59 [auto1.fr] INFO: Found listing with ID: CJ08369
2026-03-30 12:30:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:04 [auto1.fr] INFO: Channel: 24h | Page: 137 | totalHits: 5771 | hits on page: 40
2026-03-30 12:30:04 [auto1.fr] INFO: Found listing with ID: CJ08369
2026-03-30 12:30:04 [auto1.fr] INFO: Found listing with ID: AE66506
2026-03-30 12:30:04 [auto1.fr] INFO: Found listing with ID: BW44211
2026-03-30 12:30:04 [auto1.fr] INFO: Found listing with ID: WM89368
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM89368%27 HTTP/1.1" 200 None
2026-03-30 12:30:04 [auto1.fr] INFO: Scrape type for WM89368: 2
2026-03-30 12:30:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47aba43e-de77-55ce-a9a4-77826f015893 with identifier: WM89368
2026-03-30 12:30:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47aba43e-de77-55ce-a9a4-77826f015893 with scrape type 2
2026-03-30 12:30:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47aba43e-de77-55ce-a9a4-77826f015893 with scrape type 2
2026-03-30 12:30:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 47aba43e-de77-55ce-a9a4-77826f015893, identifier: WM89368
2026-03-30 12:30:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 47aba43e-de77-55ce-a9a4-77826f015893 with identifier: WM89368
2026-03-30 12:30:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 47aba43e-de77-55ce-a9a4-77826f015893 with identifier: WM89368
2026-03-30 12:30:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 47aba43e-de77-55ce-a9a4-77826f015893 with identifier: WM89368 to the API
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:49:02Z',
'fuel_type': 'hybrid',
'id': '47aba43e-de77-55ce-a9a4-77826f015893',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM89368',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 147709,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-21',
'seller_name': None,
'title': 'Peugeot 3008 2.0 HDi Hybrid4',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM89368%27 HTTP/1.1" 200 None
2026-03-30 12:30:04 [auto1.fr] INFO: Saving data for WM89368: {'auction_closing_time': 1774885742.0, 'created_time': 1773432548.274845, 'last_price_update_time': 1774873804.545816}
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WM89368') HTTP/1.1" 204 0
2026-03-30 12:30:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:04 [auto1.fr] INFO: Found listing with ID: VS10894
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS10894%27 HTTP/1.1" 200 None
2026-03-30 12:30:04 [auto1.fr] INFO: Scrape type for VS10894: 2
2026-03-30 12:30:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08744b84-2ec6-5f8a-9671-66f6db6541be with identifier: VS10894
2026-03-30 12:30:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08744b84-2ec6-5f8a-9671-66f6db6541be with scrape type 2
2026-03-30 12:30:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08744b84-2ec6-5f8a-9671-66f6db6541be with scrape type 2
2026-03-30 12:30:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 08744b84-2ec6-5f8a-9671-66f6db6541be, identifier: VS10894
2026-03-30 12:30:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 08744b84-2ec6-5f8a-9671-66f6db6541be with identifier: VS10894
2026-03-30 12:30:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 08744b84-2ec6-5f8a-9671-66f6db6541be with identifier: VS10894
2026-03-30 12:30:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 08744b84-2ec6-5f8a-9671-66f6db6541be with identifier: VS10894 to the API
2026-03-30 12:30:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:08:37Z',
'fuel_type': 'diesel',
'id': '08744b84-2ec6-5f8a-9671-66f6db6541be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS10894',
'listing': 'auction',
'make': 'Peugeot',
'model': '4007',
'odometer': 244177,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-02-20',
'seller_name': None,
'title': 'Peugeot 4007 2.2 HDi Feline',
'transmission': 'manual',
'trim': 'Feline',
'year': 2008}
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS10894%27 HTTP/1.1" 200 None
2026-03-30 12:30:05 [auto1.fr] INFO: Saving data for VS10894: {'auction_closing_time': 1774883317.0, 'created_time': 1774696152.272972, 'last_price_update_time': 1774873805.65061}
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VS10894') HTTP/1.1" 204 0
2026-03-30 12:30:05 [auto1.fr] INFO: Found listing with ID: CZ80373
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ80373%27 HTTP/1.1" 200 None
2026-03-30 12:30:05 [auto1.fr] INFO: Scrape type for CZ80373: 2
2026-03-30 12:30:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d1c84da-2a89-5173-8543-21d4b14d099f with identifier: CZ80373
2026-03-30 12:30:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d1c84da-2a89-5173-8543-21d4b14d099f with scrape type 2
2026-03-30 12:30:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d1c84da-2a89-5173-8543-21d4b14d099f with scrape type 2
2026-03-30 12:30:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2d1c84da-2a89-5173-8543-21d4b14d099f, identifier: CZ80373
2026-03-30 12:30:05 [scrapy.extensions.logstats] INFO: Crawled 385 pages (at 10 pages/min), scraped 257 items (at 29 items/min)
2026-03-30 12:30:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:30:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2d1c84da-2a89-5173-8543-21d4b14d099f with identifier: CZ80373
2026-03-30 12:30:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2d1c84da-2a89-5173-8543-21d4b14d099f with identifier: CZ80373
2026-03-30 12:30:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2d1c84da-2a89-5173-8543-21d4b14d099f with identifier: CZ80373 to the API
2026-03-30 12:30:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:40:12Z',
'fuel_type': 'diesel',
'id': '2d1c84da-2a89-5173-8543-21d4b14d099f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ80373',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 65768,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-30',
'seller_name': None,
'title': 'Peugeot 308 2.0 Blue-HDi GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2020}
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ80373%27 HTTP/1.1" 200 None
2026-03-30 12:30:06 [auto1.fr] INFO: Saving data for CZ80373: {'auction_closing_time': 1774885212.0, 'created_time': 1774696132.743935, 'last_price_update_time': 1774873806.142605}
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CZ80373') HTTP/1.1" 204 0
2026-03-30 12:30:06 [auto1.fr] INFO: Found listing with ID: FW18570
2026-03-30 12:30:06 [auto1.fr] INFO: Found listing with ID: TY66124
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY66124%27 HTTP/1.1" 200 None
2026-03-30 12:30:06 [auto1.fr] INFO: Scrape type for TY66124: 2
2026-03-30 12:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48a88794-fde5-5042-a855-3ac1b1e2708d with identifier: TY66124
2026-03-30 12:30:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48a88794-fde5-5042-a855-3ac1b1e2708d with scrape type 2
2026-03-30 12:30:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48a88794-fde5-5042-a855-3ac1b1e2708d with scrape type 2
2026-03-30 12:30:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 48a88794-fde5-5042-a855-3ac1b1e2708d, identifier: TY66124
2026-03-30 12:30:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 48a88794-fde5-5042-a855-3ac1b1e2708d with identifier: TY66124
2026-03-30 12:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 48a88794-fde5-5042-a855-3ac1b1e2708d with identifier: TY66124
2026-03-30 12:30:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 48a88794-fde5-5042-a855-3ac1b1e2708d with identifier: TY66124 to the API
2026-03-30 12:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:20:14Z',
'fuel_type': 'diesel',
'id': '48a88794-fde5-5042-a855-3ac1b1e2708d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY66124',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 160024,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-09',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Carat Edition BlueMotion',
'transmission': 'automatic',
'trim': 'Carat Edition BlueMotion',
'year': 2017}
2026-03-30 12:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY66124%27 HTTP/1.1" 200 None
2026-03-30 12:30:07 [auto1.fr] INFO: Saving data for TY66124: {'auction_closing_time': 1774884014.0, 'created_time': 1774124084.083117, 'last_price_update_time': 1774873807.345719}
2026-03-30 12:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TY66124') HTTP/1.1" 204 0
2026-03-30 12:30:07 [auto1.fr] INFO: Found listing with ID: KM00607
2026-03-30 12:30:07 [auto1.fr] INFO: Found listing with ID: XE59820
2026-03-30 12:30:07 [auto1.fr] INFO: Found listing with ID: DV07221
2026-03-30 12:30:07 [auto1.fr] INFO: Found listing with ID: GB17264
2026-03-30 12:30:07 [auto1.fr] INFO: Found listing with ID: HK13953
2026-03-30 12:30:07 [auto1.fr] INFO: Found listing with ID: TX61285
2026-03-30 12:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX61285%27 HTTP/1.1" 200 None
2026-03-30 12:30:07 [auto1.fr] INFO: Scrape type for TX61285: 2
2026-03-30 12:30:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8af03af3-7be2-52eb-a6d1-e4c0ff547d4b with identifier: TX61285
2026-03-30 12:30:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8af03af3-7be2-52eb-a6d1-e4c0ff547d4b with scrape type 2
2026-03-30 12:30:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8af03af3-7be2-52eb-a6d1-e4c0ff547d4b with scrape type 2
2026-03-30 12:30:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8af03af3-7be2-52eb-a6d1-e4c0ff547d4b, identifier: TX61285
2026-03-30 12:30:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8af03af3-7be2-52eb-a6d1-e4c0ff547d4b with identifier: TX61285
2026-03-30 12:30:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8af03af3-7be2-52eb-a6d1-e4c0ff547d4b with identifier: TX61285
2026-03-30 12:30:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8af03af3-7be2-52eb-a6d1-e4c0ff547d4b with identifier: TX61285 to the API
2026-03-30 12:30:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:40:25Z',
'fuel_type': 'petrol',
'id': '8af03af3-7be2-52eb-a6d1-e4c0ff547d4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX61285',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 100375,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-18',
'seller_name': None,
'title': 'Renault Captur 0.9 Energy Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2018}
2026-03-30 12:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX61285%27 HTTP/1.1" 200 None
2026-03-30 12:30:07 [auto1.fr] INFO: Saving data for TX61285: {'auction_closing_time': 1774885225.0, 'created_time': 1774105603.326749, 'last_price_update_time': 1774873807.840864}
2026-03-30 12:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TX61285') HTTP/1.1" 204 0
2026-03-30 12:30:07 [auto1.fr] INFO: Found listing with ID: SW87984
2026-03-30 12:30:07 [auto1.fr] INFO: Found listing with ID: VH67706
2026-03-30 12:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH67706%27 HTTP/1.1" 200 None
2026-03-30 12:30:07 [auto1.fr] INFO: Scrape type for VH67706: 2
2026-03-30 12:30:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a529bab6-f2f0-5af8-bb27-7d68eab9fcdf with identifier: VH67706
2026-03-30 12:30:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a529bab6-f2f0-5af8-bb27-7d68eab9fcdf with scrape type 2
2026-03-30 12:30:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a529bab6-f2f0-5af8-bb27-7d68eab9fcdf with scrape type 2
2026-03-30 12:30:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a529bab6-f2f0-5af8-bb27-7d68eab9fcdf, identifier: VH67706
2026-03-30 12:30:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a529bab6-f2f0-5af8-bb27-7d68eab9fcdf with identifier: VH67706
2026-03-30 12:30:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a529bab6-f2f0-5af8-bb27-7d68eab9fcdf with identifier: VH67706
2026-03-30 12:30:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a529bab6-f2f0-5af8-bb27-7d68eab9fcdf with identifier: VH67706 to the API
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:36:00Z',
'fuel_type': 'diesel',
'id': 'a529bab6-f2f0-5af8-bb27-7d68eab9fcdf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH67706',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 131504,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-28',
'seller_name': None,
'title': 'BMW 5er 520d xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2019}
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH67706%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.fr] INFO: Saving data for VH67706: {'auction_closing_time': 1774884960.0, 'created_time': 1774696140.004916, 'last_price_update_time': 1774873808.838028}
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VH67706') HTTP/1.1" 204 0
2026-03-30 12:30:08 [auto1.fr] INFO: Found listing with ID: FM52767
2026-03-30 12:30:08 [auto1.fr] INFO: Found listing with ID: VG72057
2026-03-30 12:30:08 [auto1.fr] INFO: Found listing with ID: ZU41206
2026-03-30 12:30:08 [auto1.fr] INFO: Found listing with ID: JE86127
2026-03-30 12:30:08 [auto1.fr] INFO: Found listing with ID: DE20800
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE20800%27 HTTP/1.1" 200 None
2026-03-30 12:30:08 [auto1.fr] INFO: Scrape type for DE20800: 2
2026-03-30 12:30:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08c5208b-7cbe-53c9-b3b4-e972946538a9 with identifier: DE20800
2026-03-30 12:30:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08c5208b-7cbe-53c9-b3b4-e972946538a9 with scrape type 2
2026-03-30 12:30:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08c5208b-7cbe-53c9-b3b4-e972946538a9 with scrape type 2
2026-03-30 12:30:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 08c5208b-7cbe-53c9-b3b4-e972946538a9, identifier: DE20800
2026-03-30 12:30:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 08c5208b-7cbe-53c9-b3b4-e972946538a9 with identifier: DE20800
2026-03-30 12:30:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 08c5208b-7cbe-53c9-b3b4-e972946538a9 with identifier: DE20800
2026-03-30 12:30:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 08c5208b-7cbe-53c9-b3b4-e972946538a9 with identifier: DE20800 to the API
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:19:54Z',
'fuel_type': 'diesel',
'id': '08c5208b-7cbe-53c9-b3b4-e972946538a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE20800',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 251311,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-29',
'seller_name': None,
'title': 'Dacia Sandero 1.5 dCi Stepway Prestige',
'transmission': 'manual',
'trim': 'Stepway Prestige',
'year': 2013}
2026-03-30 12:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE20800%27 HTTP/1.1" 200 None
2026-03-30 12:30:10 [auto1.fr] INFO: Saving data for DE20800: {'auction_closing_time': 1774883994.0, 'created_time': 1774124114.411707, 'last_price_update_time': 1774873810.029354}
2026-03-30 12:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DE20800') HTTP/1.1" 204 0
2026-03-30 12:30:10 [auto1.fr] INFO: Found listing with ID: FW64716
2026-03-30 12:30:10 [auto1.fr] INFO: Found listing with ID: SV92457
2026-03-30 12:30:10 [auto1.fr] INFO: Found listing with ID: TW89911
2026-03-30 12:30:10 [auto1.fr] INFO: Found listing with ID: MB74515
2026-03-30 12:30:10 [auto1.fr] INFO: Found listing with ID: BR52910
2026-03-30 12:30:10 [auto1.fr] INFO: Found listing with ID: EB26679
2026-03-30 12:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB26679%27 HTTP/1.1" 200 None
2026-03-30 12:30:10 [auto1.fr] INFO: Scrape type for EB26679: 2
2026-03-30 12:30:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00dd279e-75d2-5b1c-b687-abcb42c59143 with identifier: EB26679
2026-03-30 12:30:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00dd279e-75d2-5b1c-b687-abcb42c59143 with scrape type 2
2026-03-30 12:30:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00dd279e-75d2-5b1c-b687-abcb42c59143 with scrape type 2
2026-03-30 12:30:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 00dd279e-75d2-5b1c-b687-abcb42c59143, identifier: EB26679
2026-03-30 12:30:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 00dd279e-75d2-5b1c-b687-abcb42c59143 with identifier: EB26679
2026-03-30 12:30:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 00dd279e-75d2-5b1c-b687-abcb42c59143 with identifier: EB26679
2026-03-30 12:30:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 00dd279e-75d2-5b1c-b687-abcb42c59143 with identifier: EB26679 to the API
2026-03-30 12:30:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:05:11Z',
'fuel_type': 'diesel',
'id': '00dd279e-75d2-5b1c-b687-abcb42c59143',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB26679',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 232988,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-28',
'seller_name': None,
'title': 'Seat Ibiza 1.6 TDI Stylance / Style',
'transmission': 'manual',
'trim': 'Stylance / Style',
'year': 2010}
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB26679%27 HTTP/1.1" 200 None
2026-03-30 12:30:11 [auto1.fr] INFO: Saving data for EB26679: {'auction_closing_time': 1774883111.0, 'created_time': 1774696128.367997, 'last_price_update_time': 1774873811.846183}
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EB26679') HTTP/1.1" 204 0
2026-03-30 12:30:11 [auto1.fr] INFO: Found listing with ID: EV84221
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV84221%27 HTTP/1.1" 200 None
2026-03-30 12:30:11 [auto1.fr] INFO: Scrape type for EV84221: 2
2026-03-30 12:30:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed7d2ac8-3aa7-5fb4-994c-3a64a47947e8 with identifier: EV84221
2026-03-30 12:30:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed7d2ac8-3aa7-5fb4-994c-3a64a47947e8 with scrape type 2
2026-03-30 12:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed7d2ac8-3aa7-5fb4-994c-3a64a47947e8 with scrape type 2
2026-03-30 12:30:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ed7d2ac8-3aa7-5fb4-994c-3a64a47947e8, identifier: EV84221
2026-03-30 12:30:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ed7d2ac8-3aa7-5fb4-994c-3a64a47947e8 with identifier: EV84221
2026-03-30 12:30:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ed7d2ac8-3aa7-5fb4-994c-3a64a47947e8 with identifier: EV84221
2026-03-30 12:30:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ed7d2ac8-3aa7-5fb4-994c-3a64a47947e8 with identifier: EV84221 to the API
2026-03-30 12:30:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:03:08Z',
'fuel_type': 'hybrid',
'id': 'ed7d2ac8-3aa7-5fb4-994c-3a64a47947e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV84221',
'listing': 'auction',
'make': 'Toyota',
'model': 'Auris Touring Sports',
'odometer': 630764,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-29',
'seller_name': None,
'title': 'Toyota Auris Touring Sports 1.8 Hybrid Cool',
'transmission': 'automatic',
'trim': 'Cool',
'year': 2015}
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV84221%27 HTTP/1.1" 200 None
2026-03-30 12:30:13 [auto1.fr] INFO: Saving data for EV84221: {'auction_closing_time': 1774882988.0, 'created_time': 1773292864.222357, 'last_price_update_time': 1774873813.564957}
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EV84221') HTTP/1.1" 204 0
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: KS87605
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: DB35883
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: UK79234
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: TE23710
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: JV79615
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: GY88820
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: AB65307
2026-03-30 12:30:13 [auto1.fr] INFO: Found listing with ID: CP93730
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP93730%27 HTTP/1.1" 200 None
2026-03-30 12:30:13 [auto1.fr] INFO: Scrape type for CP93730: 2
2026-03-30 12:30:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff626dde-07ef-56f1-b1d8-bf3e052e9954 with identifier: CP93730
2026-03-30 12:30:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff626dde-07ef-56f1-b1d8-bf3e052e9954 with scrape type 2
2026-03-30 12:30:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff626dde-07ef-56f1-b1d8-bf3e052e9954 with scrape type 2
2026-03-30 12:30:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ff626dde-07ef-56f1-b1d8-bf3e052e9954, identifier: CP93730
2026-03-30 12:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ff626dde-07ef-56f1-b1d8-bf3e052e9954 with identifier: CP93730
2026-03-30 12:30:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ff626dde-07ef-56f1-b1d8-bf3e052e9954 with identifier: CP93730
2026-03-30 12:30:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ff626dde-07ef-56f1-b1d8-bf3e052e9954 with identifier: CP93730 to the API
2026-03-30 12:30:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:37:31Z',
'fuel_type': 'petrol',
'id': 'ff626dde-07ef-56f1-b1d8-bf3e052e9954',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP93730',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLK-Klasse',
'odometer': 273956,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-07-16',
'seller_name': None,
'title': 'Mercedes-Benz CLK-Klasse CLK 200 Kompressor Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2000}
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP93730%27 HTTP/1.1" 200 None
2026-03-30 12:30:14 [auto1.fr] INFO: Saving data for CP93730: {'auction_closing_time': 1774885051.0, 'created_time': 1774696193.639327, 'last_price_update_time': 1774873814.301578}
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CP93730') HTTP/1.1" 204 0
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: ZP58759
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: XW13356
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: HU86127
2026-03-30 12:30:14 [auto1.fr] INFO: Found listing with ID: KZ36749
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KZ36749%27 HTTP/1.1" 200 None
2026-03-30 12:30:14 [auto1.fr] INFO: Scrape type for KZ36749: 2
2026-03-30 12:30:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a2e4913-511d-51ef-9479-c469df9d788b with identifier: KZ36749
2026-03-30 12:30:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a2e4913-511d-51ef-9479-c469df9d788b with scrape type 2
2026-03-30 12:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a2e4913-511d-51ef-9479-c469df9d788b with scrape type 2
2026-03-30 12:30:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3a2e4913-511d-51ef-9479-c469df9d788b, identifier: KZ36749
2026-03-30 12:30:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3a2e4913-511d-51ef-9479-c469df9d788b with identifier: KZ36749
2026-03-30 12:30:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3a2e4913-511d-51ef-9479-c469df9d788b with identifier: KZ36749
2026-03-30 12:30:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3a2e4913-511d-51ef-9479-c469df9d788b with identifier: KZ36749 to the API
2026-03-30 12:30:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:17:10Z',
'fuel_type': 'petrol',
'id': '3a2e4913-511d-51ef-9479-c469df9d788b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ36749',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 149068,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-17',
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2015}
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KZ36749%27 HTTP/1.1" 200 None
2026-03-30 12:30:15 [auto1.fr] INFO: Saving data for KZ36749: {'auction_closing_time': 1774883830.0, 'created_time': 1774696194.622099, 'last_price_update_time': 1774873815.515154}
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KZ36749') HTTP/1.1" 204 0
2026-03-30 12:30:15 [auto1.fr] INFO: Channel: 24h | Page: 138 | totalHits: 5771 | hits on page: 40
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: RV46753
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: ZT80475
2026-03-30 12:30:15 [auto1.fr] INFO: Found listing with ID: UA52654
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA52654%27 HTTP/1.1" 200 None
2026-03-30 12:30:15 [auto1.fr] INFO: Scrape type for UA52654: 2
2026-03-30 12:30:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e2ccb15-cdcd-5737-a2b9-54df49b65f8e with identifier: UA52654
2026-03-30 12:30:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e2ccb15-cdcd-5737-a2b9-54df49b65f8e with scrape type 2
2026-03-30 12:30:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e2ccb15-cdcd-5737-a2b9-54df49b65f8e with scrape type 2
2026-03-30 12:30:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3e2ccb15-cdcd-5737-a2b9-54df49b65f8e, identifier: UA52654
2026-03-30 12:30:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3e2ccb15-cdcd-5737-a2b9-54df49b65f8e with identifier: UA52654
2026-03-30 12:30:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3e2ccb15-cdcd-5737-a2b9-54df49b65f8e with identifier: UA52654
2026-03-30 12:30:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3e2ccb15-cdcd-5737-a2b9-54df49b65f8e with identifier: UA52654 to the API
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:38:54Z',
'fuel_type': 'diesel',
'id': '3e2ccb15-cdcd-5737-a2b9-54df49b65f8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA52654',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 185737,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-03',
'seller_name': None,
'title': 'Toyota RAV 4 2.0 D-4D Design',
'transmission': 'manual',
'trim': 'Design',
'year': 2016}
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA52654%27 HTTP/1.1" 200 None
2026-03-30 12:30:16 [auto1.fr] INFO: Saving data for UA52654: {'auction_closing_time': 1774885134.0, 'created_time': 1774002213.06317, 'last_price_update_time': 1774873816.050763}
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UA52654') HTTP/1.1" 204 0
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: WU18548
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU18548%27 HTTP/1.1" 200 None
2026-03-30 12:30:16 [auto1.fr] INFO: Scrape type for WU18548: 2
2026-03-30 12:30:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28f184a2-4555-5334-9a77-3f0f72736346 with identifier: WU18548
2026-03-30 12:30:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28f184a2-4555-5334-9a77-3f0f72736346 with scrape type 2
2026-03-30 12:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28f184a2-4555-5334-9a77-3f0f72736346 with scrape type 2
2026-03-30 12:30:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 28f184a2-4555-5334-9a77-3f0f72736346, identifier: WU18548
2026-03-30 12:30:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 28f184a2-4555-5334-9a77-3f0f72736346 with identifier: WU18548
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 12:30:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:30:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 28f184a2-4555-5334-9a77-3f0f72736346 with identifier: WU18548
2026-03-30 12:30:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 28f184a2-4555-5334-9a77-3f0f72736346 with identifier: WU18548 to the API
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:40:42Z',
'fuel_type': 'electro',
'id': '28f184a2-4555-5334-9a77-3f0f72736346',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU18548',
'listing': 'auction',
'make': 'BMW',
'model': 'i3',
'odometer': 73875,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-11',
'seller_name': None,
'title': 'BMW i3 i3',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU18548%27 HTTP/1.1" 200 None
2026-03-30 12:30:16 [auto1.fr] INFO: Saving data for WU18548: {'auction_closing_time': 1774885242.0, 'created_time': 1774696190.607907, 'last_price_update_time': 1774873816.714001}
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WU18548') HTTP/1.1" 204 0
2026-03-30 12:30:16 [auto1.fr] INFO: Found listing with ID: LE00933
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LE00933%27 HTTP/1.1" 200 None
2026-03-30 12:30:16 [auto1.fr] INFO: Scrape type for LE00933: 2
2026-03-30 12:30:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad4c6aea-881b-58d0-8bb7-9642e226908f with identifier: LE00933
2026-03-30 12:30:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad4c6aea-881b-58d0-8bb7-9642e226908f with scrape type 2
2026-03-30 12:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad4c6aea-881b-58d0-8bb7-9642e226908f with scrape type 2
2026-03-30 12:30:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ad4c6aea-881b-58d0-8bb7-9642e226908f, identifier: LE00933
2026-03-30 12:30:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ad4c6aea-881b-58d0-8bb7-9642e226908f with identifier: LE00933
2026-03-30 12:30:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ad4c6aea-881b-58d0-8bb7-9642e226908f with identifier: LE00933
2026-03-30 12:30:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ad4c6aea-881b-58d0-8bb7-9642e226908f with identifier: LE00933 to the API
2026-03-30 12:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:49:27Z',
'fuel_type': 'petrol',
'id': 'ad4c6aea-881b-58d0-8bb7-9642e226908f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE00933',
'listing': 'auction',
'make': 'Peugeot',
'model': '108',
'odometer': 19821,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-26',
'seller_name': None,
'title': 'Peugeot 108 1.0 VTi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2017}
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LE00933%27 HTTP/1.1" 200 None
2026-03-30 12:30:18 [auto1.fr] INFO: Saving data for LE00933: {'auction_closing_time': 1774885767.0, 'created_time': 1774696214.645448, 'last_price_update_time': 1774873818.113769}
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LE00933') HTTP/1.1" 204 0
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: XG18623
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: JV98298
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: YH02175
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: LY03626
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: SZ62625
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SZ62625%27 HTTP/1.1" 200 None
2026-03-30 12:30:18 [auto1.fr] INFO: Scrape type for SZ62625: 2
2026-03-30 12:30:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f685ee83-ecd7-53a9-b35e-2e170ad5f465 with identifier: SZ62625
2026-03-30 12:30:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f685ee83-ecd7-53a9-b35e-2e170ad5f465 with scrape type 2
2026-03-30 12:30:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f685ee83-ecd7-53a9-b35e-2e170ad5f465 with scrape type 2
2026-03-30 12:30:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f685ee83-ecd7-53a9-b35e-2e170ad5f465, identifier: SZ62625
2026-03-30 12:30:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f685ee83-ecd7-53a9-b35e-2e170ad5f465 with identifier: SZ62625
2026-03-30 12:30:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f685ee83-ecd7-53a9-b35e-2e170ad5f465 with identifier: SZ62625
2026-03-30 12:30:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f685ee83-ecd7-53a9-b35e-2e170ad5f465 with identifier: SZ62625 to the API
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:53:57Z',
'fuel_type': 'petrol',
'id': 'f685ee83-ecd7-53a9-b35e-2e170ad5f465',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ62625',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 198035,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-09-01',
'seller_name': None,
'title': 'Volkswagen Touareg 3.2 V6',
'transmission': 'automatic',
'trim': '',
'year': 2004}
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SZ62625%27 HTTP/1.1" 200 None
2026-03-30 12:30:18 [auto1.fr] INFO: Saving data for SZ62625: {'auction_closing_time': 1774886037.0, 'created_time': 1774696185.895517, 'last_price_update_time': 1774873818.551363}
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SZ62625') HTTP/1.1" 204 0
2026-03-30 12:30:18 [auto1.fr] INFO: Found listing with ID: AH69707
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH69707%27 HTTP/1.1" 200 None
2026-03-30 12:30:18 [auto1.fr] INFO: Scrape type for AH69707: 2
2026-03-30 12:30:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dbe62c3-7ab3-54b6-b1ef-f6b45f62f894 with identifier: AH69707
2026-03-30 12:30:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dbe62c3-7ab3-54b6-b1ef-f6b45f62f894 with scrape type 2
2026-03-30 12:30:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1dbe62c3-7ab3-54b6-b1ef-f6b45f62f894 with scrape type 2
2026-03-30 12:30:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1dbe62c3-7ab3-54b6-b1ef-f6b45f62f894, identifier: AH69707
2026-03-30 12:30:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1dbe62c3-7ab3-54b6-b1ef-f6b45f62f894 with identifier: AH69707
2026-03-30 12:30:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1dbe62c3-7ab3-54b6-b1ef-f6b45f62f894 with identifier: AH69707
2026-03-30 12:30:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1dbe62c3-7ab3-54b6-b1ef-f6b45f62f894 with identifier: AH69707 to the API
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:09:49Z',
'fuel_type': 'diesel',
'id': '1dbe62c3-7ab3-54b6-b1ef-f6b45f62f894',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH69707',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Viano',
'odometer': 253308,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-29',
'seller_name': None,
'title': 'Mercedes-Benz Viano 2.1 CDI lang Trend',
'transmission': 'automatic',
'trim': 'lang Trend',
'year': 2009}
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH69707%27 HTTP/1.1" 200 None
2026-03-30 12:30:18 [auto1.fr] INFO: Saving data for AH69707: {'auction_closing_time': 1774883389.0, 'created_time': 1774696189.641779, 'last_price_update_time': 1774873818.956082}
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AH69707') HTTP/1.1" 204 0
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: FH02348
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: YV09528
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: MR90529
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: TV82295
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: MP32266
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: SU11681
2026-03-30 12:30:19 [auto1.fr] INFO: Found listing with ID: RU69102
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU69102%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.fr] INFO: Scrape type for RU69102: 2
2026-03-30 12:30:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daa8a079-2e4b-542f-a883-e53fa41e0d95 with identifier: RU69102
2026-03-30 12:30:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daa8a079-2e4b-542f-a883-e53fa41e0d95 with scrape type 2
2026-03-30 12:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item daa8a079-2e4b-542f-a883-e53fa41e0d95 with scrape type 2
2026-03-30 12:30:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: daa8a079-2e4b-542f-a883-e53fa41e0d95, identifier: RU69102
2026-03-30 12:30:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: daa8a079-2e4b-542f-a883-e53fa41e0d95 with identifier: RU69102
2026-03-30 12:30:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: daa8a079-2e4b-542f-a883-e53fa41e0d95 with identifier: RU69102
2026-03-30 12:30:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: daa8a079-2e4b-542f-a883-e53fa41e0d95 with identifier: RU69102 to the API
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:53:15Z',
'fuel_type': 'diesel',
'id': 'daa8a079-2e4b-542f-a883-e53fa41e0d95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU69102',
'listing': 'auction',
'make': 'Fiat',
'model': 'Doblo',
'odometer': 117010,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-22',
'seller_name': None,
'title': 'Fiat Doblo 1.3 M-Jet Pack Professional Fourgon',
'transmission': 'manual',
'trim': 'Pack Professional Fourgon',
'year': 2018}
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU69102%27 HTTP/1.1" 200 None
2026-03-30 12:30:20 [auto1.fr] INFO: Saving data for RU69102: {'auction_closing_time': 1774885995.0, 'created_time': 1774696208.639388, 'last_price_update_time': 1774873820.048853}
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RU69102') HTTP/1.1" 204 0
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: LU27709
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: CE53888
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: VW71703
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: MG17007
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG17007%27 HTTP/1.1" 200 None
2026-03-30 12:30:20 [auto1.fr] INFO: Scrape type for MG17007: 2
2026-03-30 12:30:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2495e548-bb29-5224-b9a0-0d9c9c9a3db3 with identifier: MG17007
2026-03-30 12:30:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2495e548-bb29-5224-b9a0-0d9c9c9a3db3 with scrape type 2
2026-03-30 12:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2495e548-bb29-5224-b9a0-0d9c9c9a3db3 with scrape type 2
2026-03-30 12:30:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2495e548-bb29-5224-b9a0-0d9c9c9a3db3, identifier: MG17007
2026-03-30 12:30:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2495e548-bb29-5224-b9a0-0d9c9c9a3db3 with identifier: MG17007
2026-03-30 12:30:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2495e548-bb29-5224-b9a0-0d9c9c9a3db3 with identifier: MG17007
2026-03-30 12:30:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2495e548-bb29-5224-b9a0-0d9c9c9a3db3 with identifier: MG17007 to the API
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:24:37Z',
'fuel_type': 'petrol',
'id': '2495e548-bb29-5224-b9a0-0d9c9c9a3db3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG17007',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 108937,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-28',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2016}
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG17007%27 HTTP/1.1" 200 None
2026-03-30 12:30:20 [auto1.fr] INFO: Saving data for MG17007: {'auction_closing_time': 1774884277.0, 'created_time': 1774696223.189537, 'last_price_update_time': 1774873820.468927}
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MG17007') HTTP/1.1" 204 0
2026-03-30 12:30:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:20 [auto1.fr] INFO: Found listing with ID: XP22019
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP22019%27 HTTP/1.1" 200 None
2026-03-30 12:30:20 [auto1.fr] INFO: Scrape type for XP22019: 2
2026-03-30 12:30:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38fc05ab-0ee3-5564-ba4d-1f43ded30266 with identifier: XP22019
2026-03-30 12:30:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38fc05ab-0ee3-5564-ba4d-1f43ded30266 with scrape type 2
2026-03-30 12:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38fc05ab-0ee3-5564-ba4d-1f43ded30266 with scrape type 2
2026-03-30 12:30:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 38fc05ab-0ee3-5564-ba4d-1f43ded30266, identifier: XP22019
2026-03-30 12:30:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 38fc05ab-0ee3-5564-ba4d-1f43ded30266 with identifier: XP22019
2026-03-30 12:30:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 38fc05ab-0ee3-5564-ba4d-1f43ded30266 with identifier: XP22019
2026-03-30 12:30:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 38fc05ab-0ee3-5564-ba4d-1f43ded30266 with identifier: XP22019 to the API
2026-03-30 12:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:56:33Z',
'fuel_type': 'petrol',
'id': '38fc05ab-0ee3-5564-ba4d-1f43ded30266',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP22019',
'listing': 'auction',
'make': 'Kia',
'model': 'Picanto',
'odometer': 76493,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-12-08',
'seller_name': None,
'title': 'Kia Picanto 1.0 FIFA World Cup',
'transmission': 'manual',
'trim': 'FIFA World Cup',
'year': 2009}
2026-03-30 12:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP22019%27 HTTP/1.1" 200 None
2026-03-30 12:30:21 [auto1.fr] INFO: Saving data for XP22019: {'auction_closing_time': 1774886193.0, 'created_time': 1774696296.794686, 'last_price_update_time': 1774873821.774756}
2026-03-30 12:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XP22019') HTTP/1.1" 204 0
2026-03-30 12:30:21 [auto1.fr] INFO: Found listing with ID: NE40848
2026-03-30 12:30:21 [auto1.fr] INFO: Found listing with ID: GV78371
2026-03-30 12:30:21 [auto1.fr] INFO: Found listing with ID: HK73367
2026-03-30 12:30:21 [auto1.fr] INFO: Found listing with ID: JL98574
2026-03-30 12:30:21 [auto1.fr] INFO: Found listing with ID: SR44134
2026-03-30 12:30:21 [auto1.fr] INFO: Found listing with ID: KD87845
2026-03-30 12:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD87845%27 HTTP/1.1" 200 None
2026-03-30 12:30:21 [auto1.fr] INFO: Scrape type for KD87845: 2
2026-03-30 12:30:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40dec99a-68ef-5a2d-8aba-b414297d31f8 with identifier: KD87845
2026-03-30 12:30:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40dec99a-68ef-5a2d-8aba-b414297d31f8 with scrape type 2
2026-03-30 12:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40dec99a-68ef-5a2d-8aba-b414297d31f8 with scrape type 2
2026-03-30 12:30:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 40dec99a-68ef-5a2d-8aba-b414297d31f8, identifier: KD87845
2026-03-30 12:30:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 40dec99a-68ef-5a2d-8aba-b414297d31f8 with identifier: KD87845
2026-03-30 12:30:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 40dec99a-68ef-5a2d-8aba-b414297d31f8 with identifier: KD87845
2026-03-30 12:30:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 40dec99a-68ef-5a2d-8aba-b414297d31f8 with identifier: KD87845 to the API
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:29:00Z',
'fuel_type': 'petrol',
'id': '40dec99a-68ef-5a2d-8aba-b414297d31f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD87845',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 111250,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-25',
'seller_name': None,
'title': 'Peugeot 2008 1.2 VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2013}
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD87845%27 HTTP/1.1" 200 None
2026-03-30 12:30:22 [auto1.fr] INFO: Saving data for KD87845: {'auction_closing_time': 1774884540.0, 'created_time': 1774038380.415224, 'last_price_update_time': 1774873822.242613}
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KD87845') HTTP/1.1" 204 0
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: FM74121
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: JG76127
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: DW50914
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: FC98721
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: NX77985
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: YR20155
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR20155%27 HTTP/1.1" 200 None
2026-03-30 12:30:22 [auto1.fr] INFO: Scrape type for YR20155: 2
2026-03-30 12:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acf1666e-4d18-5e28-a9a3-51e31c780594 with identifier: YR20155
2026-03-30 12:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acf1666e-4d18-5e28-a9a3-51e31c780594 with scrape type 2
2026-03-30 12:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acf1666e-4d18-5e28-a9a3-51e31c780594 with scrape type 2
2026-03-30 12:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: acf1666e-4d18-5e28-a9a3-51e31c780594, identifier: YR20155
2026-03-30 12:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: acf1666e-4d18-5e28-a9a3-51e31c780594 with identifier: YR20155
2026-03-30 12:30:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: acf1666e-4d18-5e28-a9a3-51e31c780594 with identifier: YR20155
2026-03-30 12:30:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: acf1666e-4d18-5e28-a9a3-51e31c780594 with identifier: YR20155 to the API
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:39:16Z',
'fuel_type': 'diesel',
'id': 'acf1666e-4d18-5e28-a9a3-51e31c780594',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR20155',
'listing': 'auction',
'make': 'Mazda',
'model': '3',
'odometer': 111033,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-19',
'seller_name': None,
'title': 'Mazda 3 1.6 CD Diesel Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2008}
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR20155%27 HTTP/1.1" 200 None
2026-03-30 12:30:22 [auto1.fr] INFO: Saving data for YR20155: {'auction_closing_time': 1774885156.0, 'created_time': 1774696237.27443, 'last_price_update_time': 1774873822.665844}
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YR20155') HTTP/1.1" 204 0
2026-03-30 12:30:22 [auto1.fr] INFO: Channel: 24h | Page: 139 | totalHits: 5771 | hits on page: 40
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: TB56422
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: MB84611
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: JC48947
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: KB91378
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: WR66923
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: FZ59181
2026-03-30 12:30:22 [auto1.fr] INFO: Found listing with ID: DE84379
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE84379%27 HTTP/1.1" 200 None
2026-03-30 12:30:22 [auto1.fr] INFO: Scrape type for DE84379: 2
2026-03-30 12:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcbabc82-53ad-5402-8d52-3abc6b166402 with identifier: DE84379
2026-03-30 12:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcbabc82-53ad-5402-8d52-3abc6b166402 with scrape type 2
2026-03-30 12:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcbabc82-53ad-5402-8d52-3abc6b166402 with scrape type 2
2026-03-30 12:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dcbabc82-53ad-5402-8d52-3abc6b166402, identifier: DE84379
2026-03-30 12:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dcbabc82-53ad-5402-8d52-3abc6b166402 with identifier: DE84379
2026-03-30 12:30:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dcbabc82-53ad-5402-8d52-3abc6b166402 with identifier: DE84379
2026-03-30 12:30:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dcbabc82-53ad-5402-8d52-3abc6b166402 with identifier: DE84379 to the API
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 88,
'expiration_date': '2026-03-30T15:23:39Z',
'fuel_type': 'petrol',
'id': 'dcbabc82-53ad-5402-8d52-3abc6b166402',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE84379',
'listing': 'auction',
'make': 'Nissan',
'model': 'Micra',
'odometer': 103319,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-04',
'seller_name': None,
'title': 'Nissan Micra 1.4 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2006}
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE84379%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.fr] INFO: Saving data for DE84379: {'auction_closing_time': 1774884219.0, 'created_time': 1774696404.473264, 'last_price_update_time': 1774873823.836873}
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DE84379') HTTP/1.1" 204 0
2026-03-30 12:30:23 [auto1.fr] INFO: Found listing with ID: PF16962
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF16962%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.fr] INFO: Scrape type for PF16962: 2
2026-03-30 12:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2705d165-275d-5fc9-9c61-c01d593441e1 with identifier: PF16962
2026-03-30 12:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2705d165-275d-5fc9-9c61-c01d593441e1 with scrape type 2
2026-03-30 12:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2705d165-275d-5fc9-9c61-c01d593441e1 with scrape type 2
2026-03-30 12:30:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2705d165-275d-5fc9-9c61-c01d593441e1, identifier: PF16962
2026-03-30 12:30:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2705d165-275d-5fc9-9c61-c01d593441e1 with identifier: PF16962
2026-03-30 12:30:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2705d165-275d-5fc9-9c61-c01d593441e1 with identifier: PF16962
2026-03-30 12:30:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2705d165-275d-5fc9-9c61-c01d593441e1 with identifier: PF16962 to the API
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 152,
'expiration_date': '2026-03-30T15:53:41Z',
'fuel_type': 'petrol',
'id': '2705d165-275d-5fc9-9c61-c01d593441e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF16962',
'listing': 'auction',
'make': 'Volvo',
'model': 'V40 Cross Country',
'odometer': 99293,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-31',
'seller_name': None,
'title': 'Volvo V40 Cross Country 1.5 Momentum',
'transmission': 'automatic',
'trim': 'Momentum',
'year': 2019}
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF16962%27 HTTP/1.1" 200 None
2026-03-30 12:30:24 [auto1.fr] INFO: Saving data for PF16962: {'auction_closing_time': 1774886021.0, 'created_time': 1774696361.990888, 'last_price_update_time': 1774873824.269571}
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PF16962') HTTP/1.1" 204 0
2026-03-30 12:30:24 [auto1.fr] INFO: Found listing with ID: UC64780
2026-03-30 12:30:24 [auto1.fr] INFO: Found listing with ID: VW13197
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW13197%27 HTTP/1.1" 200 None
2026-03-30 12:30:24 [auto1.fr] INFO: Scrape type for VW13197: 2
2026-03-30 12:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fef2c16-8038-5b4b-acc1-ba4316bf59a8 with identifier: VW13197
2026-03-30 12:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fef2c16-8038-5b4b-acc1-ba4316bf59a8 with scrape type 2
2026-03-30 12:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fef2c16-8038-5b4b-acc1-ba4316bf59a8 with scrape type 2
2026-03-30 12:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5fef2c16-8038-5b4b-acc1-ba4316bf59a8, identifier: VW13197
2026-03-30 12:30:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5fef2c16-8038-5b4b-acc1-ba4316bf59a8 with identifier: VW13197
2026-03-30 12:30:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5fef2c16-8038-5b4b-acc1-ba4316bf59a8 with identifier: VW13197
2026-03-30 12:30:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5fef2c16-8038-5b4b-acc1-ba4316bf59a8 with identifier: VW13197 to the API
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:19:39Z',
'fuel_type': 'hybrid',
'id': '5fef2c16-8038-5b4b-acc1-ba4316bf59a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW13197',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris Cross',
'odometer': 52685,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-30',
'seller_name': None,
'title': 'Toyota Yaris Cross 1.5 Hybrid Design',
'transmission': 'automatic',
'trim': 'Design',
'year': 2023}
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW13197%27 HTTP/1.1" 200 None
2026-03-30 12:30:24 [auto1.fr] INFO: Saving data for VW13197: {'auction_closing_time': 1774883979.0, 'created_time': 1774091371.824169, 'last_price_update_time': 1774873824.673818}
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VW13197') HTTP/1.1" 204 0
2026-03-30 12:30:24 [auto1.fr] INFO: Found listing with ID: WU44169
2026-03-30 12:30:24 [auto1.fr] INFO: Found listing with ID: XS04857
2026-03-30 12:30:24 [auto1.fr] INFO: Found listing with ID: JA97847
2026-03-30 12:30:24 [auto1.fr] INFO: Found listing with ID: LZ93851
2026-03-30 12:30:24 [auto1.fr] INFO: Found listing with ID: JR02755
2026-03-30 12:30:24 [auto1.fr] INFO: Found listing with ID: JX92727
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX92727%27 HTTP/1.1" 200 None
2026-03-30 12:30:24 [auto1.fr] INFO: Scrape type for JX92727: 2
2026-03-30 12:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4bf88ed-8a04-584e-a2c3-e5bbe7538f40 with identifier: JX92727
2026-03-30 12:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4bf88ed-8a04-584e-a2c3-e5bbe7538f40 with scrape type 2
2026-03-30 12:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4bf88ed-8a04-584e-a2c3-e5bbe7538f40 with scrape type 2
2026-03-30 12:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d4bf88ed-8a04-584e-a2c3-e5bbe7538f40, identifier: JX92727
2026-03-30 12:30:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d4bf88ed-8a04-584e-a2c3-e5bbe7538f40 with identifier: JX92727
2026-03-30 12:30:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d4bf88ed-8a04-584e-a2c3-e5bbe7538f40 with identifier: JX92727
2026-03-30 12:30:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d4bf88ed-8a04-584e-a2c3-e5bbe7538f40 with identifier: JX92727 to the API
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 299,
'expiration_date': '2026-03-30T15:03:31Z',
'fuel_type': 'hybrid',
'id': 'd4bf88ed-8a04-584e-a2c3-e5bbe7538f40',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX92727',
'listing': 'auction',
'make': 'Lexus',
'model': 'RX-Serie',
'odometer': 219767,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-14',
'seller_name': None,
'title': 'Lexus RX-Serie RX 450h Ambience',
'transmission': 'automatic',
'trim': 'Ambience',
'year': 2013}
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX92727%27 HTTP/1.1" 200 None
2026-03-30 12:30:25 [auto1.fr] INFO: Saving data for JX92727: {'auction_closing_time': 1774883011.0, 'created_time': 1774696225.219835, 'last_price_update_time': 1774873825.863471}
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JX92727') HTTP/1.1" 204 0
2026-03-30 12:30:25 [auto1.fr] INFO: Found listing with ID: LV66662
2026-03-30 12:30:25 [auto1.fr] INFO: Found listing with ID: BD56063
2026-03-30 12:30:25 [auto1.fr] INFO: Found listing with ID: ZG27680
2026-03-30 12:30:25 [auto1.fr] INFO: Found listing with ID: HD25172
2026-03-30 12:30:25 [auto1.fr] INFO: Found listing with ID: AY04507
2026-03-30 12:30:25 [auto1.fr] INFO: Found listing with ID: YR62966
2026-03-30 12:30:25 [auto1.fr] INFO: Found listing with ID: TX07099
2026-03-30 12:30:25 [auto1.fr] INFO: Found listing with ID: VN82721
2026-03-30 12:30:25 [auto1.fr] INFO: Found listing with ID: JN44204
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN44204%27 HTTP/1.1" 200 None
2026-03-30 12:30:26 [auto1.fr] INFO: Scrape type for JN44204: 2
2026-03-30 12:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab2fe4ba-5e0b-5f56-94f5-34732deff84f with identifier: JN44204
2026-03-30 12:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab2fe4ba-5e0b-5f56-94f5-34732deff84f with scrape type 2
2026-03-30 12:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab2fe4ba-5e0b-5f56-94f5-34732deff84f with scrape type 2
2026-03-30 12:30:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ab2fe4ba-5e0b-5f56-94f5-34732deff84f, identifier: JN44204
2026-03-30 12:30:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ab2fe4ba-5e0b-5f56-94f5-34732deff84f with identifier: JN44204
2026-03-30 12:30:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ab2fe4ba-5e0b-5f56-94f5-34732deff84f with identifier: JN44204
2026-03-30 12:30:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ab2fe4ba-5e0b-5f56-94f5-34732deff84f with identifier: JN44204 to the API
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:55:27Z',
'fuel_type': 'diesel',
'id': 'ab2fe4ba-5e0b-5f56-94f5-34732deff84f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN44204',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 191319,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-06',
'seller_name': None,
'title': 'Volkswagen Beetle 2.0 TDI Fender Edition',
'transmission': 'manual',
'trim': 'Fender Edition',
'year': 2013}
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN44204%27 HTTP/1.1" 200 None
2026-03-30 12:30:26 [auto1.fr] INFO: Saving data for JN44204: {'auction_closing_time': 1774886127.0, 'created_time': 1774105652.473336, 'last_price_update_time': 1774873826.409092}
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JN44204') HTTP/1.1" 204 0
2026-03-30 12:30:26 [auto1.fr] INFO: Found listing with ID: ST75915
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST75915%27 HTTP/1.1" 200 None
2026-03-30 12:30:26 [auto1.fr] INFO: Scrape type for ST75915: 2
2026-03-30 12:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f273396e-9380-5711-97a1-736636ba1740 with identifier: ST75915
2026-03-30 12:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f273396e-9380-5711-97a1-736636ba1740 with scrape type 2
2026-03-30 12:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f273396e-9380-5711-97a1-736636ba1740 with scrape type 2
2026-03-30 12:30:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f273396e-9380-5711-97a1-736636ba1740, identifier: ST75915
2026-03-30 12:30:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f273396e-9380-5711-97a1-736636ba1740 with identifier: ST75915
2026-03-30 12:30:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f273396e-9380-5711-97a1-736636ba1740 with identifier: ST75915
2026-03-30 12:30:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f273396e-9380-5711-97a1-736636ba1740 with identifier: ST75915 to the API
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 77,
'expiration_date': '2026-03-30T15:55:50Z',
'fuel_type': 'hybrid',
'id': 'f273396e-9380-5711-97a1-736636ba1740',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST75915',
'listing': 'auction',
'make': 'Toyota',
'model': 'Prius',
'odometer': 267714,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-16',
'seller_name': None,
'title': 'Toyota Prius 1.5 Sol',
'transmission': 'automatic',
'trim': 'Sol',
'year': 2008}
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST75915%27 HTTP/1.1" 200 None
2026-03-30 12:30:26 [auto1.fr] INFO: Saving data for ST75915: {'auction_closing_time': 1774886150.0, 'created_time': 1774124066.610501, 'last_price_update_time': 1774873826.854499}
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ST75915') HTTP/1.1" 204 0
2026-03-30 12:30:26 [auto1.fr] INFO: Found listing with ID: ZW79920
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW79920%27 HTTP/1.1" 200 None
2026-03-30 12:30:26 [auto1.fr] INFO: Scrape type for ZW79920: 2
2026-03-30 12:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ef55bfe-bef7-5cd5-a25d-08a12f89c85c with identifier: ZW79920
2026-03-30 12:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ef55bfe-bef7-5cd5-a25d-08a12f89c85c with scrape type 2
2026-03-30 12:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ef55bfe-bef7-5cd5-a25d-08a12f89c85c with scrape type 2
2026-03-30 12:30:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6ef55bfe-bef7-5cd5-a25d-08a12f89c85c, identifier: ZW79920
2026-03-30 12:30:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6ef55bfe-bef7-5cd5-a25d-08a12f89c85c with identifier: ZW79920
2026-03-30 12:30:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6ef55bfe-bef7-5cd5-a25d-08a12f89c85c with identifier: ZW79920
2026-03-30 12:30:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6ef55bfe-bef7-5cd5-a25d-08a12f89c85c with identifier: ZW79920 to the API
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:58:15Z',
'fuel_type': 'diesel',
'id': '6ef55bfe-bef7-5cd5-a25d-08a12f89c85c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW79920',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 223762,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-04-23',
'seller_name': None,
'title': 'Peugeot 308 1.6 HDi Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2008}
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW79920%27 HTTP/1.1" 200 None
2026-03-30 12:30:27 [auto1.fr] INFO: Saving data for ZW79920: {'auction_closing_time': 1774886295.0, 'created_time': 1774696310.682291, 'last_price_update_time': 1774873827.256423}
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZW79920') HTTP/1.1" 204 0
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: PV10246
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: NR12452
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: FG62413
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG62413%27 HTTP/1.1" 200 None
2026-03-30 12:30:27 [auto1.fr] INFO: Scrape type for FG62413: 2
2026-03-30 12:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16ae6e39-e719-5a82-8787-16fdb57269c9 with identifier: FG62413
2026-03-30 12:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16ae6e39-e719-5a82-8787-16fdb57269c9 with scrape type 2
2026-03-30 12:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16ae6e39-e719-5a82-8787-16fdb57269c9 with scrape type 2
2026-03-30 12:30:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 16ae6e39-e719-5a82-8787-16fdb57269c9, identifier: FG62413
2026-03-30 12:30:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 16ae6e39-e719-5a82-8787-16fdb57269c9 with identifier: FG62413
2026-03-30 12:30:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 16ae6e39-e719-5a82-8787-16fdb57269c9 with identifier: FG62413
2026-03-30 12:30:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 16ae6e39-e719-5a82-8787-16fdb57269c9 with identifier: FG62413 to the API
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:30:15Z',
'fuel_type': 'diesel',
'id': '16ae6e39-e719-5a82-8787-16fdb57269c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG62413',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 271117,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-24',
'seller_name': None,
'title': 'Opel Astra 1.7 CDTI Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2011}
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG62413%27 HTTP/1.1" 200 None
2026-03-30 12:30:28 [auto1.fr] INFO: Saving data for FG62413: {'auction_closing_time': 1774884615.0, 'created_time': 1774696315.408686, 'last_price_update_time': 1774873828.321939}
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FG62413') HTTP/1.1" 204 0
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: HC97852
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC97852%27 HTTP/1.1" 200 None
2026-03-30 12:30:28 [auto1.fr] INFO: Scrape type for HC97852: 2
2026-03-30 12:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2817d10a-a763-5193-9504-3444e923168b with identifier: HC97852
2026-03-30 12:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2817d10a-a763-5193-9504-3444e923168b with scrape type 2
2026-03-30 12:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2817d10a-a763-5193-9504-3444e923168b with scrape type 2
2026-03-30 12:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2817d10a-a763-5193-9504-3444e923168b, identifier: HC97852
2026-03-30 12:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2817d10a-a763-5193-9504-3444e923168b with identifier: HC97852
2026-03-30 12:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2817d10a-a763-5193-9504-3444e923168b with identifier: HC97852
2026-03-30 12:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2817d10a-a763-5193-9504-3444e923168b with identifier: HC97852 to the API
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:48:33Z',
'fuel_type': 'petrol',
'id': '2817d10a-a763-5193-9504-3444e923168b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC97852',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 107758,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-23',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure Business',
'transmission': 'manual',
'trim': 'Allure Business',
'year': 2016}
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC97852%27 HTTP/1.1" 200 None
2026-03-30 12:30:28 [auto1.fr] INFO: Saving data for HC97852: {'auction_closing_time': 1774885713.0, 'created_time': 1774696314.257503, 'last_price_update_time': 1774873828.782364}
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HC97852') HTTP/1.1" 204 0
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: YT59313
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: VC76298
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: DJ57711
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: FV08721
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: GA24586
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA24586%27 HTTP/1.1" 200 None
2026-03-30 12:30:28 [auto1.fr] INFO: Scrape type for GA24586: 2
2026-03-30 12:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7267ddd6-f1aa-530c-8c42-43c7b19cecab with identifier: GA24586
2026-03-30 12:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7267ddd6-f1aa-530c-8c42-43c7b19cecab with scrape type 2
2026-03-30 12:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7267ddd6-f1aa-530c-8c42-43c7b19cecab with scrape type 2
2026-03-30 12:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7267ddd6-f1aa-530c-8c42-43c7b19cecab, identifier: GA24586
2026-03-30 12:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7267ddd6-f1aa-530c-8c42-43c7b19cecab with identifier: GA24586
2026-03-30 12:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7267ddd6-f1aa-530c-8c42-43c7b19cecab with identifier: GA24586
2026-03-30 12:30:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7267ddd6-f1aa-530c-8c42-43c7b19cecab with identifier: GA24586 to the API
2026-03-30 12:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:22:55Z',
'fuel_type': 'petrol',
'id': '7267ddd6-f1aa-530c-8c42-43c7b19cecab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA24586',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 132315,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-19',
'seller_name': None,
'title': 'Peugeot 208 1.0 VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-30 12:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA24586%27 HTTP/1.1" 200 None
2026-03-30 12:30:29 [auto1.fr] INFO: Saving data for GA24586: {'auction_closing_time': 1774884175.0, 'created_time': 1774696277.988603, 'last_price_update_time': 1774873829.213165}
2026-03-30 12:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GA24586') HTTP/1.1" 204 0
2026-03-30 12:30:29 [auto1.fr] INFO: Found listing with ID: DM39147
2026-03-30 12:30:29 [auto1.fr] INFO: Found listing with ID: HG44047
2026-03-30 12:30:29 [auto1.fr] INFO: Found listing with ID: FM15642
2026-03-30 12:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM15642%27 HTTP/1.1" 200 None
2026-03-30 12:30:29 [auto1.fr] INFO: Scrape type for FM15642: 2
2026-03-30 12:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17bf9805-7a97-527f-83ee-c4f27bd83bd0 with identifier: FM15642
2026-03-30 12:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17bf9805-7a97-527f-83ee-c4f27bd83bd0 with scrape type 2
2026-03-30 12:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17bf9805-7a97-527f-83ee-c4f27bd83bd0 with scrape type 2
2026-03-30 12:30:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 17bf9805-7a97-527f-83ee-c4f27bd83bd0, identifier: FM15642
2026-03-30 12:30:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 17bf9805-7a97-527f-83ee-c4f27bd83bd0 with identifier: FM15642
2026-03-30 12:30:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 17bf9805-7a97-527f-83ee-c4f27bd83bd0 with identifier: FM15642
2026-03-30 12:30:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 17bf9805-7a97-527f-83ee-c4f27bd83bd0 with identifier: FM15642 to the API
2026-03-30 12:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:16:11Z',
'fuel_type': 'diesel',
'id': '17bf9805-7a97-527f-83ee-c4f27bd83bd0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM15642',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 105047,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-04',
'seller_name': None,
'title': 'Volkswagen T-Roc 2.0 TDI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2020}
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM15642%27 HTTP/1.1" 200 None
2026-03-30 12:30:30 [auto1.fr] INFO: Saving data for FM15642: {'auction_closing_time': 1774883771.0, 'created_time': 1774696334.823243, 'last_price_update_time': 1774873830.111417}
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FM15642') HTTP/1.1" 204 0
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: HZ10967
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: KR77540
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: VU68372
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU68372%27 HTTP/1.1" 200 None
2026-03-30 12:30:30 [auto1.fr] INFO: Scrape type for VU68372: 2
2026-03-30 12:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38744976-cb22-5e22-b9d7-e54ca38d14e7 with identifier: VU68372
2026-03-30 12:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38744976-cb22-5e22-b9d7-e54ca38d14e7 with scrape type 2
2026-03-30 12:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38744976-cb22-5e22-b9d7-e54ca38d14e7 with scrape type 2
2026-03-30 12:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 38744976-cb22-5e22-b9d7-e54ca38d14e7, identifier: VU68372
2026-03-30 12:30:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 38744976-cb22-5e22-b9d7-e54ca38d14e7 with identifier: VU68372
2026-03-30 12:30:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 38744976-cb22-5e22-b9d7-e54ca38d14e7 with identifier: VU68372
2026-03-30 12:30:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 38744976-cb22-5e22-b9d7-e54ca38d14e7 with identifier: VU68372 to the API
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:53:04Z',
'fuel_type': 'petrol',
'id': '38744976-cb22-5e22-b9d7-e54ca38d14e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU68372',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 147215,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-10',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 FSI Sportline',
'transmission': 'manual',
'trim': 'Sportline',
'year': 2012}
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU68372%27 HTTP/1.1" 200 None
2026-03-30 12:30:31 [auto1.fr] INFO: Saving data for VU68372: {'auction_closing_time': 1774885984.0, 'created_time': 1774696276.296688, 'last_price_update_time': 1774873831.079851}
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VU68372') HTTP/1.1" 204 0
2026-03-30 12:30:31 [auto1.fr] INFO: Found listing with ID: ZL41639
2026-03-30 12:30:31 [auto1.fr] INFO: Found listing with ID: YU85764
2026-03-30 12:30:31 [auto1.fr] INFO: Found listing with ID: TX31203
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX31203%27 HTTP/1.1" 200 None
2026-03-30 12:30:31 [auto1.fr] INFO: Scrape type for TX31203: 2
2026-03-30 12:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b623ebe9-780e-5ce5-aba7-35fe3094c566 with identifier: TX31203
2026-03-30 12:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b623ebe9-780e-5ce5-aba7-35fe3094c566 with scrape type 2
2026-03-30 12:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b623ebe9-780e-5ce5-aba7-35fe3094c566 with scrape type 2
2026-03-30 12:30:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b623ebe9-780e-5ce5-aba7-35fe3094c566, identifier: TX31203
2026-03-30 12:30:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b623ebe9-780e-5ce5-aba7-35fe3094c566 with identifier: TX31203
2026-03-30 12:30:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b623ebe9-780e-5ce5-aba7-35fe3094c566 with identifier: TX31203
2026-03-30 12:30:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b623ebe9-780e-5ce5-aba7-35fe3094c566 with identifier: TX31203 to the API
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:17:35Z',
'fuel_type': 'petrol',
'id': 'b623ebe9-780e-5ce5-aba7-35fe3094c566',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX31203',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 44823,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-07',
'seller_name': None,
'title': 'Volkswagen T-Cross 1.0 TSI Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2021}
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX31203%27 HTTP/1.1" 200 None
2026-03-30 12:30:31 [auto1.fr] INFO: Saving data for TX31203: {'auction_closing_time': 1774883855.0, 'created_time': 1772773862.986351, 'last_price_update_time': 1774873831.789544}
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TX31203') HTTP/1.1" 204 0
2026-03-30 12:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:31 [auto1.fr] INFO: Channel: 24h | Page: 140 | totalHits: 5771 | hits on page: 40
2026-03-30 12:30:31 [auto1.fr] INFO: Found listing with ID: CJ72764
2026-03-30 12:30:31 [auto1.fr] INFO: Found listing with ID: HZ17638
2026-03-30 12:30:31 [auto1.fr] INFO: Found listing with ID: TL18032
2026-03-30 12:30:31 [auto1.fr] INFO: Found listing with ID: MT85865
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT85865%27 HTTP/1.1" 200 None
2026-03-30 12:30:31 [auto1.fr] INFO: Scrape type for MT85865: 2
2026-03-30 12:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c8c3574-7b2b-5f44-9914-e03dbc578097 with identifier: MT85865
2026-03-30 12:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c8c3574-7b2b-5f44-9914-e03dbc578097 with scrape type 2
2026-03-30 12:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c8c3574-7b2b-5f44-9914-e03dbc578097 with scrape type 2
2026-03-30 12:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0c8c3574-7b2b-5f44-9914-e03dbc578097, identifier: MT85865
2026-03-30 12:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0c8c3574-7b2b-5f44-9914-e03dbc578097 with identifier: MT85865
2026-03-30 12:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0c8c3574-7b2b-5f44-9914-e03dbc578097 with identifier: MT85865
2026-03-30 12:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0c8c3574-7b2b-5f44-9914-e03dbc578097 with identifier: MT85865 to the API
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:44:47Z',
'fuel_type': 'diesel',
'id': '0c8c3574-7b2b-5f44-9914-e03dbc578097',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT85865',
'listing': 'auction',
'make': 'Opel',
'model': 'Antara',
'odometer': 228366,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-01',
'seller_name': None,
'title': 'Opel Antara 2.2 CDTI Edition Pack 4x2',
'transmission': 'manual',
'trim': 'Edition Pack 4x2',
'year': 2012}
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT85865%27 HTTP/1.1" 200 None
2026-03-30 12:30:32 [auto1.fr] INFO: Saving data for MT85865: {'auction_closing_time': 1774885487.0, 'created_time': 1774696257.787416, 'last_price_update_time': 1774873832.320779}
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MT85865') HTTP/1.1" 204 0
2026-03-30 12:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: PH13525
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: PM47286
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM47286%27 HTTP/1.1" 200 None
2026-03-30 12:30:32 [auto1.fr] INFO: Scrape type for PM47286: 2
2026-03-30 12:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 025350b6-8fef-5dc9-aaf3-5bb3aa5c178a with identifier: PM47286
2026-03-30 12:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 025350b6-8fef-5dc9-aaf3-5bb3aa5c178a with scrape type 2
2026-03-30 12:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 025350b6-8fef-5dc9-aaf3-5bb3aa5c178a with scrape type 2
2026-03-30 12:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 025350b6-8fef-5dc9-aaf3-5bb3aa5c178a, identifier: PM47286
2026-03-30 12:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 025350b6-8fef-5dc9-aaf3-5bb3aa5c178a with identifier: PM47286
2026-03-30 12:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 025350b6-8fef-5dc9-aaf3-5bb3aa5c178a with identifier: PM47286
2026-03-30 12:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 025350b6-8fef-5dc9-aaf3-5bb3aa5c178a with identifier: PM47286 to the API
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:18:04Z',
'fuel_type': 'petrol',
'id': '025350b6-8fef-5dc9-aaf3-5bb3aa5c178a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM47286',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 133979,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-12-12',
'seller_name': None,
'title': 'Renault Megane 1.6 Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2007}
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM47286%27 HTTP/1.1" 200 None
2026-03-30 12:30:32 [auto1.fr] INFO: Saving data for PM47286: {'auction_closing_time': 1774883884.0, 'created_time': 1774696267.508594, 'last_price_update_time': 1774873832.762704}
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PM47286') HTTP/1.1" 204 0
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: GV65609
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: BB11677
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: VH30868
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: FE12908
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: CL98857
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL98857%27 HTTP/1.1" 200 None
2026-03-30 12:30:32 [auto1.fr] INFO: Scrape type for CL98857: 2
2026-03-30 12:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f46b0634-ad75-5ce6-9c77-0fdec9e7a020 with identifier: CL98857
2026-03-30 12:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f46b0634-ad75-5ce6-9c77-0fdec9e7a020 with scrape type 2
2026-03-30 12:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f46b0634-ad75-5ce6-9c77-0fdec9e7a020 with scrape type 2
2026-03-30 12:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f46b0634-ad75-5ce6-9c77-0fdec9e7a020, identifier: CL98857
2026-03-30 12:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f46b0634-ad75-5ce6-9c77-0fdec9e7a020 with identifier: CL98857
2026-03-30 12:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f46b0634-ad75-5ce6-9c77-0fdec9e7a020 with identifier: CL98857
2026-03-30 12:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f46b0634-ad75-5ce6-9c77-0fdec9e7a020 with identifier: CL98857 to the API
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:01:27Z',
'fuel_type': 'diesel',
'id': 'f46b0634-ad75-5ce6-9c77-0fdec9e7a020',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL98857',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 144428,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-30',
'seller_name': None,
'title': 'Audi A1 Sportback 1.6 TDI S line',
'transmission': 'manual',
'trim': 'S line',
'year': 2016}
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL98857%27 HTTP/1.1" 200 None
2026-03-30 12:30:33 [auto1.fr] INFO: Saving data for CL98857: {'auction_closing_time': 1774882887.0, 'created_time': 1774696260.201132, 'last_price_update_time': 1774873833.282863}
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CL98857') HTTP/1.1" 204 0
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: PN80130
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: WG62006
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: MS82377
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: LD94932
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: AB62030
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: AR32479
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: UB93214
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: BG44189
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: SB97802
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: PZ17655
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: VY46453
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: MP15770
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: RX15931
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: NV07557
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: AZ95896
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: SX31357
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: UE22232
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: DB93525
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: DB50817
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: UY82545
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: YP27295
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP27295%27 HTTP/1.1" 200 None
2026-03-30 12:30:33 [auto1.fr] INFO: Scrape type for YP27295: 2
2026-03-30 12:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5ade64f-b35f-5f57-8215-13a08b374b96 with identifier: YP27295
2026-03-30 12:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5ade64f-b35f-5f57-8215-13a08b374b96 with scrape type 2
2026-03-30 12:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5ade64f-b35f-5f57-8215-13a08b374b96 with scrape type 2
2026-03-30 12:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b5ade64f-b35f-5f57-8215-13a08b374b96, identifier: YP27295
2026-03-30 12:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b5ade64f-b35f-5f57-8215-13a08b374b96 with identifier: YP27295
2026-03-30 12:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b5ade64f-b35f-5f57-8215-13a08b374b96 with identifier: YP27295
2026-03-30 12:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b5ade64f-b35f-5f57-8215-13a08b374b96 with identifier: YP27295 to the API
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 181,
'expiration_date': '2026-03-30T15:36:12Z',
'fuel_type': 'petrol',
'id': 'b5ade64f-b35f-5f57-8215-13a08b374b96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP27295',
'listing': 'auction',
'make': 'Peugeot',
'model': '508',
'odometer': 89426,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-25',
'seller_name': None,
'title': 'Peugeot 508 1.6 PureTech GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2019}
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP27295%27 HTTP/1.1" 200 None
2026-03-30 12:30:33 [auto1.fr] INFO: Saving data for YP27295: {'auction_closing_time': 1774884972.0, 'created_time': 1774696329.523302, 'last_price_update_time': 1774873833.711637}
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YP27295') HTTP/1.1" 204 0
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: GR65808
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: RD87549
2026-03-30 12:30:33 [auto1.fr] INFO: Found listing with ID: VH99399
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH99399%27 HTTP/1.1" 200 None
2026-03-30 12:30:33 [auto1.fr] INFO: Scrape type for VH99399: 2
2026-03-30 12:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0109c45-b324-568e-ab14-e49d22879447 with identifier: VH99399
2026-03-30 12:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0109c45-b324-568e-ab14-e49d22879447 with scrape type 2
2026-03-30 12:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0109c45-b324-568e-ab14-e49d22879447 with scrape type 2
2026-03-30 12:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e0109c45-b324-568e-ab14-e49d22879447, identifier: VH99399
2026-03-30 12:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e0109c45-b324-568e-ab14-e49d22879447 with identifier: VH99399
2026-03-30 12:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e0109c45-b324-568e-ab14-e49d22879447 with identifier: VH99399
2026-03-30 12:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e0109c45-b324-568e-ab14-e49d22879447 with identifier: VH99399 to the API
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:34:14Z',
'fuel_type': 'diesel',
'id': 'e0109c45-b324-568e-ab14-e49d22879447',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH99399',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 222111,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-03',
'seller_name': None,
'title': 'Ford Fiesta 1.5 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2014}
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH99399%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.fr] INFO: Saving data for VH99399: {'auction_closing_time': 1774884854.0, 'created_time': 1774696331.150725, 'last_price_update_time': 1774873834.21386}
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VH99399') HTTP/1.1" 204 0
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: GN15329
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: XC86596
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: CM97397
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: XN27034
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: BR75438
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR75438%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.fr] INFO: Scrape type for BR75438: 2
2026-03-30 12:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd526731-416f-5637-8e21-a89d7cfbf19d with identifier: BR75438
2026-03-30 12:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd526731-416f-5637-8e21-a89d7cfbf19d with scrape type 2
2026-03-30 12:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd526731-416f-5637-8e21-a89d7cfbf19d with scrape type 2
2026-03-30 12:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fd526731-416f-5637-8e21-a89d7cfbf19d, identifier: BR75438
2026-03-30 12:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fd526731-416f-5637-8e21-a89d7cfbf19d with identifier: BR75438
2026-03-30 12:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fd526731-416f-5637-8e21-a89d7cfbf19d with identifier: BR75438
2026-03-30 12:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fd526731-416f-5637-8e21-a89d7cfbf19d with identifier: BR75438 to the API
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:05:14Z',
'fuel_type': 'petrol',
'id': 'fd526731-416f-5637-8e21-a89d7cfbf19d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR75438',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 52100,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-28',
'seller_name': None,
'title': 'Peugeot 308 1.2 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2023}
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR75438%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.fr] INFO: Saving data for BR75438: {'auction_closing_time': 1774883114.0, 'created_time': 1774696333.113034, 'last_price_update_time': 1774873834.621026}
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BR75438') HTTP/1.1" 204 0
2026-03-30 12:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:34 [auto1.fr] INFO: Channel: 24h | Page: 141 | totalHits: 5771 | hits on page: 40
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: DA62794
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: CM36705
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: FW89890
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: DV18698
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: GJ07999
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: AP86638
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: HR83482
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: XE72026
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: HM48780
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: GF26639
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: MG94762
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: ZJ78333
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: RJ07481
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: WJ84235
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: DP76483
2026-03-30 12:30:34 [auto1.fr] INFO: Found listing with ID: SB48799
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB48799%27 HTTP/1.1" 200 None
2026-03-30 12:30:35 [auto1.fr] INFO: Scrape type for SB48799: 2
2026-03-30 12:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99445987-9d7b-5b6c-9ccd-2c502ed9c40a with identifier: SB48799
2026-03-30 12:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99445987-9d7b-5b6c-9ccd-2c502ed9c40a with scrape type 2
2026-03-30 12:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99445987-9d7b-5b6c-9ccd-2c502ed9c40a with scrape type 2
2026-03-30 12:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 99445987-9d7b-5b6c-9ccd-2c502ed9c40a, identifier: SB48799
2026-03-30 12:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 99445987-9d7b-5b6c-9ccd-2c502ed9c40a with identifier: SB48799
2026-03-30 12:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 99445987-9d7b-5b6c-9ccd-2c502ed9c40a with identifier: SB48799
2026-03-30 12:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 99445987-9d7b-5b6c-9ccd-2c502ed9c40a with identifier: SB48799 to the API
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:16:35Z',
'fuel_type': 'petrol',
'id': '99445987-9d7b-5b6c-9ccd-2c502ed9c40a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB48799',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 181425,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-27',
'seller_name': None,
'title': 'Opel Meriva 1.4 Turbo Cosmo Pack',
'transmission': 'manual',
'trim': 'Cosmo Pack',
'year': 2013}
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB48799%27 HTTP/1.1" 200 None
2026-03-30 12:30:35 [auto1.fr] INFO: Saving data for SB48799: {'auction_closing_time': 1774883795.0, 'created_time': 1774696357.098871, 'last_price_update_time': 1774873835.373749}
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SB48799') HTTP/1.1" 204 0
2026-03-30 12:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:35 [auto1.fr] INFO: Found listing with ID: CE16671
2026-03-30 12:30:35 [auto1.fr] INFO: Found listing with ID: LX88375
2026-03-30 12:30:35 [auto1.fr] INFO: Found listing with ID: CC07713
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC07713%27 HTTP/1.1" 200 None
2026-03-30 12:30:35 [auto1.fr] INFO: Scrape type for CC07713: 2
2026-03-30 12:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de44fe41-7fca-5aaa-93aa-ca46646aabeb with identifier: CC07713
2026-03-30 12:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de44fe41-7fca-5aaa-93aa-ca46646aabeb with scrape type 2
2026-03-30 12:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de44fe41-7fca-5aaa-93aa-ca46646aabeb with scrape type 2
2026-03-30 12:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: de44fe41-7fca-5aaa-93aa-ca46646aabeb, identifier: CC07713
2026-03-30 12:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: de44fe41-7fca-5aaa-93aa-ca46646aabeb with identifier: CC07713
2026-03-30 12:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: de44fe41-7fca-5aaa-93aa-ca46646aabeb with identifier: CC07713
2026-03-30 12:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: de44fe41-7fca-5aaa-93aa-ca46646aabeb with identifier: CC07713 to the API
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:27:30Z',
'fuel_type': 'diesel',
'id': 'de44fe41-7fca-5aaa-93aa-ca46646aabeb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC07713',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 247994,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-14',
'seller_name': None,
'title': 'Peugeot 207 1.4 HDi Affaire Pack CD Clim Confort',
'transmission': 'manual',
'trim': 'Affaire Pack CD Clim Confort',
'year': 2011}
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC07713%27 HTTP/1.1" 200 None
2026-03-30 12:30:35 [auto1.fr] INFO: Saving data for CC07713: {'auction_closing_time': 1774884450.0, 'created_time': 1774696360.208306, 'last_price_update_time': 1774873835.876064}
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CC07713') HTTP/1.1" 204 0
2026-03-30 12:30:35 [auto1.fr] INFO: Found listing with ID: NX23430
2026-03-30 12:30:35 [auto1.fr] INFO: Found listing with ID: ME50584
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME50584%27 HTTP/1.1" 200 None
2026-03-30 12:30:35 [auto1.fr] INFO: Scrape type for ME50584: 2
2026-03-30 12:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8af02ab8-28c9-531f-b0f4-01f740165b62 with identifier: ME50584
2026-03-30 12:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8af02ab8-28c9-531f-b0f4-01f740165b62 with scrape type 2
2026-03-30 12:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8af02ab8-28c9-531f-b0f4-01f740165b62 with scrape type 2
2026-03-30 12:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8af02ab8-28c9-531f-b0f4-01f740165b62, identifier: ME50584
2026-03-30 12:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8af02ab8-28c9-531f-b0f4-01f740165b62 with identifier: ME50584
2026-03-30 12:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8af02ab8-28c9-531f-b0f4-01f740165b62 with identifier: ME50584
2026-03-30 12:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8af02ab8-28c9-531f-b0f4-01f740165b62 with identifier: ME50584 to the API
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:32:58Z',
'fuel_type': 'petrol',
'id': '8af02ab8-28c9-531f-b0f4-01f740165b62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME50584',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 256023,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-25',
'seller_name': None,
'title': 'Renault Scenic 1.4 TCe Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2011}
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME50584%27 HTTP/1.1" 200 None
2026-03-30 12:30:36 [auto1.fr] INFO: Saving data for ME50584: {'auction_closing_time': 1774884778.0, 'created_time': 1774696359.411117, 'last_price_update_time': 1774873836.282739}
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ME50584') HTTP/1.1" 204 0
2026-03-30 12:30:36 [auto1.fr] INFO: Found listing with ID: MC04904
2026-03-30 12:30:36 [auto1.fr] INFO: Found listing with ID: XC86703
2026-03-30 12:30:36 [auto1.fr] INFO: Found listing with ID: LT86952
2026-03-30 12:30:36 [auto1.fr] INFO: Found listing with ID: ZB78862
2026-03-30 12:30:36 [auto1.fr] INFO: Found listing with ID: DT31786
2026-03-30 12:30:36 [auto1.fr] INFO: Found listing with ID: CF56983
2026-03-30 12:30:36 [auto1.fr] INFO: Found listing with ID: TW49846
2026-03-30 12:30:36 [auto1.fr] INFO: Found listing with ID: GP42968
2026-03-30 12:30:36 [auto1.fr] INFO: Found listing with ID: WV66962
2026-03-30 12:30:36 [auto1.fr] INFO: Found listing with ID: WY14956
2026-03-30 12:30:36 [auto1.fr] INFO: Found listing with ID: NH48548
2026-03-30 12:30:36 [auto1.fr] INFO: Found listing with ID: KJ16018
2026-03-30 12:30:36 [auto1.fr] INFO: Found listing with ID: HU61885
2026-03-30 12:30:36 [auto1.fr] INFO: Found listing with ID: PA55290
2026-03-30 12:30:36 [auto1.fr] INFO: Found listing with ID: EH68691
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH68691%27 HTTP/1.1" 200 None
2026-03-30 12:30:36 [auto1.fr] INFO: Scrape type for EH68691: 2
2026-03-30 12:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c46dcc9-2cef-507e-8027-289a45afabf9 with identifier: EH68691
2026-03-30 12:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c46dcc9-2cef-507e-8027-289a45afabf9 with scrape type 2
2026-03-30 12:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c46dcc9-2cef-507e-8027-289a45afabf9 with scrape type 2
2026-03-30 12:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8c46dcc9-2cef-507e-8027-289a45afabf9, identifier: EH68691
2026-03-30 12:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8c46dcc9-2cef-507e-8027-289a45afabf9 with identifier: EH68691
2026-03-30 12:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8c46dcc9-2cef-507e-8027-289a45afabf9 with identifier: EH68691
2026-03-30 12:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8c46dcc9-2cef-507e-8027-289a45afabf9 with identifier: EH68691 to the API
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 360,
'expiration_date': '2026-03-30T15:36:18Z',
'fuel_type': 'hybrid',
'id': '8c46dcc9-2cef-507e-8027-289a45afabf9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH68691',
'listing': 'auction',
'make': 'Peugeot',
'model': '508',
'odometer': 112372,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-30',
'seller_name': None,
'title': 'Peugeot 508 1.6 Hybrid PSE',
'transmission': 'automatic',
'trim': 'PSE',
'year': 2021}
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH68691%27 HTTP/1.1" 200 None
2026-03-30 12:30:36 [auto1.fr] INFO: Saving data for EH68691: {'auction_closing_time': 1774884978.0, 'created_time': 1774696372.723789, 'last_price_update_time': 1774873836.764807}
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EH68691') HTTP/1.1" 204 0
2026-03-30 12:30:36 [auto1.fr] INFO: Found listing with ID: WE11934
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE11934%27 HTTP/1.1" 200 None
2026-03-30 12:30:36 [auto1.fr] INFO: Scrape type for WE11934: 2
2026-03-30 12:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ae8fe83-c696-5736-b746-3e8f7ea12d39 with identifier: WE11934
2026-03-30 12:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ae8fe83-c696-5736-b746-3e8f7ea12d39 with scrape type 2
2026-03-30 12:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ae8fe83-c696-5736-b746-3e8f7ea12d39 with scrape type 2
2026-03-30 12:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4ae8fe83-c696-5736-b746-3e8f7ea12d39, identifier: WE11934
2026-03-30 12:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4ae8fe83-c696-5736-b746-3e8f7ea12d39 with identifier: WE11934
2026-03-30 12:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4ae8fe83-c696-5736-b746-3e8f7ea12d39 with identifier: WE11934
2026-03-30 12:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4ae8fe83-c696-5736-b746-3e8f7ea12d39 with identifier: WE11934 to the API
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:57:11Z',
'fuel_type': 'diesel',
'id': '4ae8fe83-c696-5736-b746-3e8f7ea12d39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE11934',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 148713,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-27',
'seller_name': None,
'title': 'Audi A6 40 TDI Mild-Hybrid Avus',
'transmission': 'automatic',
'trim': 'Avus',
'year': 2019}
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE11934%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.fr] INFO: Saving data for WE11934: {'auction_closing_time': 1774886231.0, 'created_time': 1774555537.131719, 'last_price_update_time': 1774873837.29125}
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WE11934') HTTP/1.1" 204 0
2026-03-30 12:30:37 [auto1.fr] INFO: Found listing with ID: FC40190
2026-03-30 12:30:37 [auto1.fr] INFO: Found listing with ID: BW32282
2026-03-30 12:30:37 [auto1.fr] INFO: Found listing with ID: DP07678
2026-03-30 12:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:38 [auto1.fr] INFO: Channel: 24h | Page: 142 | totalHits: 5771 | hits on page: 40
2026-03-30 12:30:38 [auto1.fr] INFO: Found listing with ID: TZ20525
2026-03-30 12:30:38 [auto1.fr] INFO: Found listing with ID: PL68366
2026-03-30 12:30:38 [auto1.fr] INFO: Found listing with ID: GE38693
2026-03-30 12:30:38 [auto1.fr] INFO: Found listing with ID: FH21450
2026-03-30 12:30:38 [auto1.fr] INFO: Found listing with ID: LY94549
2026-03-30 12:30:38 [auto1.fr] INFO: Found listing with ID: RM84382
2026-03-30 12:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM84382%27 HTTP/1.1" 200 None
2026-03-30 12:30:38 [auto1.fr] INFO: Scrape type for RM84382: 2
2026-03-30 12:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d47aae2-8452-5623-812f-a8f8b13a4795 with identifier: RM84382
2026-03-30 12:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d47aae2-8452-5623-812f-a8f8b13a4795 with scrape type 2
2026-03-30 12:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d47aae2-8452-5623-812f-a8f8b13a4795 with scrape type 2
2026-03-30 12:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7d47aae2-8452-5623-812f-a8f8b13a4795, identifier: RM84382
2026-03-30 12:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7d47aae2-8452-5623-812f-a8f8b13a4795 with identifier: RM84382
2026-03-30 12:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7d47aae2-8452-5623-812f-a8f8b13a4795 with identifier: RM84382
2026-03-30 12:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7d47aae2-8452-5623-812f-a8f8b13a4795 with identifier: RM84382 to the API
2026-03-30 12:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:34:00Z',
'fuel_type': 'diesel',
'id': '7d47aae2-8452-5623-812f-a8f8b13a4795',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM84382',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 201273,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-29',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 220 d 4Matic Fascination',
'transmission': 'automatic',
'trim': '4Matic Fascination',
'year': 2016}
2026-03-30 12:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM84382%27 HTTP/1.1" 200 None
2026-03-30 12:30:38 [auto1.fr] INFO: Saving data for RM84382: {'auction_closing_time': 1774884840.0, 'created_time': 1773432350.560415, 'last_price_update_time': 1774873838.865401}
2026-03-30 12:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RM84382') HTTP/1.1" 204 0
2026-03-30 12:30:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:38 [auto1.fr] INFO: Found listing with ID: BC92447
2026-03-30 12:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC92447%27 HTTP/1.1" 200 None
2026-03-30 12:30:38 [auto1.fr] INFO: Scrape type for BC92447: 2
2026-03-30 12:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2576bc65-2035-54da-8fa3-b14fc14e66fa with identifier: BC92447
2026-03-30 12:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2576bc65-2035-54da-8fa3-b14fc14e66fa with scrape type 2
2026-03-30 12:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2576bc65-2035-54da-8fa3-b14fc14e66fa with scrape type 2
2026-03-30 12:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2576bc65-2035-54da-8fa3-b14fc14e66fa, identifier: BC92447
2026-03-30 12:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2576bc65-2035-54da-8fa3-b14fc14e66fa with identifier: BC92447
2026-03-30 12:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2576bc65-2035-54da-8fa3-b14fc14e66fa with identifier: BC92447
2026-03-30 12:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2576bc65-2035-54da-8fa3-b14fc14e66fa with identifier: BC92447 to the API
2026-03-30 12:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:09:51Z',
'fuel_type': 'diesel',
'id': '2576bc65-2035-54da-8fa3-b14fc14e66fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC92447',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 212239,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-05',
'seller_name': None,
'title': 'Peugeot 308 1.5 Blue-HDi Active Business',
'transmission': 'automatic',
'trim': 'Active Business',
'year': 2020}
2026-03-30 12:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC92447%27 HTTP/1.1" 200 None
2026-03-30 12:30:39 [auto1.fr] INFO: Saving data for BC92447: {'auction_closing_time': 1774883391.0, 'created_time': 1774696364.205917, 'last_price_update_time': 1774873839.2668}
2026-03-30 12:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BC92447') HTTP/1.1" 204 0
2026-03-30 12:30:39 [auto1.fr] INFO: Found listing with ID: RK17714
2026-03-30 12:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK17714%27 HTTP/1.1" 200 None
2026-03-30 12:30:39 [auto1.fr] INFO: Scrape type for RK17714: 2
2026-03-30 12:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b98a5a7-8540-5bbc-aa8b-d3e883553ee6 with identifier: RK17714
2026-03-30 12:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b98a5a7-8540-5bbc-aa8b-d3e883553ee6 with scrape type 2
2026-03-30 12:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b98a5a7-8540-5bbc-aa8b-d3e883553ee6 with scrape type 2
2026-03-30 12:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5b98a5a7-8540-5bbc-aa8b-d3e883553ee6, identifier: RK17714
2026-03-30 12:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5b98a5a7-8540-5bbc-aa8b-d3e883553ee6 with identifier: RK17714
2026-03-30 12:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5b98a5a7-8540-5bbc-aa8b-d3e883553ee6 with identifier: RK17714
2026-03-30 12:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5b98a5a7-8540-5bbc-aa8b-d3e883553ee6 with identifier: RK17714 to the API
2026-03-30 12:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:11:39Z',
'fuel_type': 'petrol',
'id': '5b98a5a7-8540-5bbc-aa8b-d3e883553ee6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK17714',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 114480,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-29',
'seller_name': None,
'title': 'Peugeot 2008 1.2 e-THP GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2016}
2026-03-30 12:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK17714%27 HTTP/1.1" 200 None
2026-03-30 12:30:39 [auto1.fr] INFO: Saving data for RK17714: {'auction_closing_time': 1774883499.0, 'created_time': 1774696370.905517, 'last_price_update_time': 1774873839.768758}
2026-03-30 12:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RK17714') HTTP/1.1" 204 0
2026-03-30 12:30:39 [auto1.fr] INFO: Found listing with ID: CT39588
2026-03-30 12:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT39588%27 HTTP/1.1" 200 None
2026-03-30 12:30:39 [auto1.fr] INFO: Scrape type for CT39588: 2
2026-03-30 12:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a45d80d-5f96-57f0-a938-236a187bcc21 with identifier: CT39588
2026-03-30 12:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a45d80d-5f96-57f0-a938-236a187bcc21 with scrape type 2
2026-03-30 12:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a45d80d-5f96-57f0-a938-236a187bcc21 with scrape type 2
2026-03-30 12:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2a45d80d-5f96-57f0-a938-236a187bcc21, identifier: CT39588
2026-03-30 12:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2a45d80d-5f96-57f0-a938-236a187bcc21 with identifier: CT39588
2026-03-30 12:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2a45d80d-5f96-57f0-a938-236a187bcc21 with identifier: CT39588
2026-03-30 12:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2a45d80d-5f96-57f0-a938-236a187bcc21 with identifier: CT39588 to the API
2026-03-30 12:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:13:13Z',
'fuel_type': 'diesel',
'id': '2a45d80d-5f96-57f0-a938-236a187bcc21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT39588',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 175667,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-22',
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2014}
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT39588%27 HTTP/1.1" 200 None
2026-03-30 12:30:40 [auto1.fr] INFO: Saving data for CT39588: {'auction_closing_time': 1774883593.0, 'created_time': 1774696376.581163, 'last_price_update_time': 1774873840.153682}
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CT39588') HTTP/1.1" 204 0
2026-03-30 12:30:40 [auto1.fr] INFO: Found listing with ID: DV98597
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV98597%27 HTTP/1.1" 200 None
2026-03-30 12:30:40 [auto1.fr] INFO: Scrape type for DV98597: 2
2026-03-30 12:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 351e9c0b-4184-5fa7-b3cc-f4733c7fadac with identifier: DV98597
2026-03-30 12:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 351e9c0b-4184-5fa7-b3cc-f4733c7fadac with scrape type 2
2026-03-30 12:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 351e9c0b-4184-5fa7-b3cc-f4733c7fadac with scrape type 2
2026-03-30 12:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 351e9c0b-4184-5fa7-b3cc-f4733c7fadac, identifier: DV98597
2026-03-30 12:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 351e9c0b-4184-5fa7-b3cc-f4733c7fadac with identifier: DV98597
2026-03-30 12:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 351e9c0b-4184-5fa7-b3cc-f4733c7fadac with identifier: DV98597
2026-03-30 12:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 351e9c0b-4184-5fa7-b3cc-f4733c7fadac with identifier: DV98597 to the API
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:59:15Z',
'fuel_type': 'diesel',
'id': '351e9c0b-4184-5fa7-b3cc-f4733c7fadac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV98597',
'listing': 'auction',
'make': 'Peugeot',
'model': '5008',
'odometer': 17695,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-11-14',
'seller_name': None,
'title': 'Peugeot 5008 1.5 Blue-HDi Allure Pack',
'transmission': 'automatic',
'trim': 'Allure Pack',
'year': 2024}
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV98597%27 HTTP/1.1" 200 None
2026-03-30 12:30:40 [auto1.fr] INFO: Saving data for DV98597: {'auction_closing_time': 1774886355.0, 'created_time': 1774015155.657281, 'last_price_update_time': 1774873840.572805}
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DV98597') HTTP/1.1" 204 0
2026-03-30 12:30:40 [auto1.fr] INFO: Found listing with ID: BU46785
2026-03-30 12:30:40 [auto1.fr] INFO: Found listing with ID: LA98443
2026-03-30 12:30:40 [auto1.fr] INFO: Found listing with ID: ZZ77973
2026-03-30 12:30:40 [auto1.fr] INFO: Found listing with ID: PN32981
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PN32981%27 HTTP/1.1" 200 None
2026-03-30 12:30:40 [auto1.fr] INFO: Scrape type for PN32981: 2
2026-03-30 12:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e98c7f7-543e-5a56-8fad-8258640afbfc with identifier: PN32981
2026-03-30 12:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e98c7f7-543e-5a56-8fad-8258640afbfc with scrape type 2
2026-03-30 12:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e98c7f7-543e-5a56-8fad-8258640afbfc with scrape type 2
2026-03-30 12:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8e98c7f7-543e-5a56-8fad-8258640afbfc, identifier: PN32981
2026-03-30 12:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8e98c7f7-543e-5a56-8fad-8258640afbfc with identifier: PN32981
2026-03-30 12:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8e98c7f7-543e-5a56-8fad-8258640afbfc with identifier: PN32981
2026-03-30 12:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8e98c7f7-543e-5a56-8fad-8258640afbfc with identifier: PN32981 to the API
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:59:29Z',
'fuel_type': 'diesel',
'id': '8e98c7f7-543e-5a56-8fad-8258640afbfc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN32981',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 332660,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-11',
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2011}
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PN32981%27 HTTP/1.1" 200 None
2026-03-30 12:30:40 [auto1.fr] INFO: Saving data for PN32981: {'auction_closing_time': 1774886369.0, 'created_time': 1774696376.178473, 'last_price_update_time': 1774873840.979384}
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PN32981') HTTP/1.1" 204 0
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: YT21957
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: MU00546
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: AK34290
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK34290%27 HTTP/1.1" 200 None
2026-03-30 12:30:41 [auto1.fr] INFO: Scrape type for AK34290: 2
2026-03-30 12:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5b287d4-7eda-5607-981e-71e61dc3315c with identifier: AK34290
2026-03-30 12:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5b287d4-7eda-5607-981e-71e61dc3315c with scrape type 2
2026-03-30 12:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5b287d4-7eda-5607-981e-71e61dc3315c with scrape type 2
2026-03-30 12:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d5b287d4-7eda-5607-981e-71e61dc3315c, identifier: AK34290
2026-03-30 12:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d5b287d4-7eda-5607-981e-71e61dc3315c with identifier: AK34290
2026-03-30 12:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d5b287d4-7eda-5607-981e-71e61dc3315c with identifier: AK34290
2026-03-30 12:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d5b287d4-7eda-5607-981e-71e61dc3315c with identifier: AK34290 to the API
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:09:22Z',
'fuel_type': 'petrol',
'id': 'd5b287d4-7eda-5607-981e-71e61dc3315c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK34290',
'listing': 'auction',
'make': 'Peugeot',
'model': '107',
'odometer': 128510,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-28',
'seller_name': None,
'title': 'Peugeot 107 1.0 Trendy',
'transmission': 'automatic',
'trim': 'Trendy',
'year': 2010}
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK34290%27 HTTP/1.1" 200 None
2026-03-30 12:30:41 [auto1.fr] INFO: Saving data for AK34290: {'auction_closing_time': 1774883362.0, 'created_time': 1774696375.753371, 'last_price_update_time': 1774873841.401486}
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AK34290') HTTP/1.1" 204 0
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: SJ62177
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ62177%27 HTTP/1.1" 200 None
2026-03-30 12:30:41 [auto1.fr] INFO: Scrape type for SJ62177: 2
2026-03-30 12:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90c580e9-f571-5a3b-8c66-6c262fc0a5cc with identifier: SJ62177
2026-03-30 12:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90c580e9-f571-5a3b-8c66-6c262fc0a5cc with scrape type 2
2026-03-30 12:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90c580e9-f571-5a3b-8c66-6c262fc0a5cc with scrape type 2
2026-03-30 12:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 90c580e9-f571-5a3b-8c66-6c262fc0a5cc, identifier: SJ62177
2026-03-30 12:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 90c580e9-f571-5a3b-8c66-6c262fc0a5cc with identifier: SJ62177
2026-03-30 12:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 90c580e9-f571-5a3b-8c66-6c262fc0a5cc with identifier: SJ62177
2026-03-30 12:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 90c580e9-f571-5a3b-8c66-6c262fc0a5cc with identifier: SJ62177 to the API
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:19:17Z',
'fuel_type': 'petrol',
'id': '90c580e9-f571-5a3b-8c66-6c262fc0a5cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ62177',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 106618,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1999-02-11',
'seller_name': None,
'title': 'Renault Clio 1.6 Initiale',
'transmission': 'automatic',
'trim': 'Initiale',
'year': 1999}
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ62177%27 HTTP/1.1" 200 None
2026-03-30 12:30:41 [auto1.fr] INFO: Saving data for SJ62177: {'auction_closing_time': 1774883957.0, 'created_time': 1774696363.275193, 'last_price_update_time': 1774873841.808585}
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SJ62177') HTTP/1.1" 204 0
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: UD34679
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD34679%27 HTTP/1.1" 200 None
2026-03-30 12:30:41 [auto1.fr] INFO: Scrape type for UD34679: 2
2026-03-30 12:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1ca07cc-2c85-5f68-a99f-88e0a1e7eb38 with identifier: UD34679
2026-03-30 12:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1ca07cc-2c85-5f68-a99f-88e0a1e7eb38 with scrape type 2
2026-03-30 12:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1ca07cc-2c85-5f68-a99f-88e0a1e7eb38 with scrape type 2
2026-03-30 12:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f1ca07cc-2c85-5f68-a99f-88e0a1e7eb38, identifier: UD34679
2026-03-30 12:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f1ca07cc-2c85-5f68-a99f-88e0a1e7eb38 with identifier: UD34679
2026-03-30 12:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f1ca07cc-2c85-5f68-a99f-88e0a1e7eb38 with identifier: UD34679
2026-03-30 12:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f1ca07cc-2c85-5f68-a99f-88e0a1e7eb38 with identifier: UD34679 to the API
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:32:16Z',
'fuel_type': 'petrol',
'id': 'f1ca07cc-2c85-5f68-a99f-88e0a1e7eb38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD34679',
'listing': 'auction',
'make': 'Peugeot',
'model': '5008',
'odometer': 119180,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-30',
'seller_name': None,
'title': 'Peugeot 5008 1.2 PureTech Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2020}
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD34679%27 HTTP/1.1" 200 None
2026-03-30 12:30:42 [auto1.fr] INFO: Saving data for UD34679: {'auction_closing_time': 1774884736.0, 'created_time': 1773950799.851155, 'last_price_update_time': 1774873842.360767}
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UD34679') HTTP/1.1" 204 0
2026-03-30 12:30:42 [auto1.fr] INFO: Found listing with ID: HV46569
2026-03-30 12:30:42 [auto1.fr] INFO: Found listing with ID: KX69726
2026-03-30 12:30:42 [auto1.fr] INFO: Found listing with ID: VN68211
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN68211%27 HTTP/1.1" 200 None
2026-03-30 12:30:42 [auto1.fr] INFO: Scrape type for VN68211: 2
2026-03-30 12:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb213590-0ab2-5304-9279-9b202995921d with identifier: VN68211
2026-03-30 12:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb213590-0ab2-5304-9279-9b202995921d with scrape type 2
2026-03-30 12:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb213590-0ab2-5304-9279-9b202995921d with scrape type 2
2026-03-30 12:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fb213590-0ab2-5304-9279-9b202995921d, identifier: VN68211
2026-03-30 12:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fb213590-0ab2-5304-9279-9b202995921d with identifier: VN68211
2026-03-30 12:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fb213590-0ab2-5304-9279-9b202995921d with identifier: VN68211
2026-03-30 12:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fb213590-0ab2-5304-9279-9b202995921d with identifier: VN68211 to the API
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:29:47Z',
'fuel_type': 'petrol',
'id': 'fb213590-0ab2-5304-9279-9b202995921d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN68211',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 231565,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-18',
'seller_name': None,
'title': 'Peugeot 207 1.6 Premium Outdoor',
'transmission': 'manual',
'trim': 'Premium Outdoor',
'year': 2009}
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN68211%27 HTTP/1.1" 200 None
2026-03-30 12:30:42 [auto1.fr] INFO: Saving data for VN68211: {'auction_closing_time': 1774884587.0, 'created_time': 1774265117.105656, 'last_price_update_time': 1774873842.744692}
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VN68211') HTTP/1.1" 204 0
2026-03-30 12:30:42 [auto1.fr] INFO: Found listing with ID: BY88224
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY88224%27 HTTP/1.1" 200 None
2026-03-30 12:30:42 [auto1.fr] INFO: Scrape type for BY88224: 2
2026-03-30 12:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e28e0f71-cefd-5a0f-8e6a-fc32e201049d with identifier: BY88224
2026-03-30 12:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e28e0f71-cefd-5a0f-8e6a-fc32e201049d with scrape type 2
2026-03-30 12:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e28e0f71-cefd-5a0f-8e6a-fc32e201049d with scrape type 2
2026-03-30 12:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e28e0f71-cefd-5a0f-8e6a-fc32e201049d, identifier: BY88224
2026-03-30 12:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e28e0f71-cefd-5a0f-8e6a-fc32e201049d with identifier: BY88224
2026-03-30 12:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e28e0f71-cefd-5a0f-8e6a-fc32e201049d with identifier: BY88224
2026-03-30 12:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e28e0f71-cefd-5a0f-8e6a-fc32e201049d with identifier: BY88224 to the API
2026-03-30 12:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:05:46Z',
'fuel_type': 'petrol',
'id': 'e28e0f71-cefd-5a0f-8e6a-fc32e201049d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY88224',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 32855,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-24',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2021}
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY88224%27 HTTP/1.1" 200 None
2026-03-30 12:30:43 [auto1.fr] INFO: Saving data for BY88224: {'auction_closing_time': 1774883146.0, 'created_time': 1774696373.166095, 'last_price_update_time': 1774873843.154511}
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BY88224') HTTP/1.1" 204 0
2026-03-30 12:30:43 [auto1.fr] INFO: Found listing with ID: EH00431
2026-03-30 12:30:43 [auto1.fr] INFO: Found listing with ID: SV19654
2026-03-30 12:30:43 [auto1.fr] INFO: Found listing with ID: VX83406
2026-03-30 12:30:43 [auto1.fr] INFO: Found listing with ID: VD01234
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD01234%27 HTTP/1.1" 200 None
2026-03-30 12:30:43 [auto1.fr] INFO: Scrape type for VD01234: 2
2026-03-30 12:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e533a03e-8272-5bba-a888-5271d64f3a0d with identifier: VD01234
2026-03-30 12:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e533a03e-8272-5bba-a888-5271d64f3a0d with scrape type 2
2026-03-30 12:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e533a03e-8272-5bba-a888-5271d64f3a0d with scrape type 2
2026-03-30 12:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e533a03e-8272-5bba-a888-5271d64f3a0d, identifier: VD01234
2026-03-30 12:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e533a03e-8272-5bba-a888-5271d64f3a0d with identifier: VD01234
2026-03-30 12:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e533a03e-8272-5bba-a888-5271d64f3a0d with identifier: VD01234
2026-03-30 12:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e533a03e-8272-5bba-a888-5271d64f3a0d with identifier: VD01234 to the API
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 87,
'expiration_date': '2026-03-30T15:08:00Z',
'fuel_type': 'petrol',
'id': 'e533a03e-8272-5bba-a888-5271d64f3a0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD01234',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 215257,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-06-13',
'seller_name': None,
'title': 'Toyota Yaris 1.3 VVT-i Luna',
'transmission': 'manual',
'trim': 'Luna',
'year': 2006}
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD01234%27 HTTP/1.1" 200 None
2026-03-30 12:30:43 [auto1.fr] INFO: Saving data for VD01234: {'auction_closing_time': 1774883280.0, 'created_time': 1772949987.114199, 'last_price_update_time': 1774873843.541695}
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VD01234') HTTP/1.1" 204 0
2026-03-30 12:30:43 [auto1.fr] INFO: Found listing with ID: MH96092
2026-03-30 12:30:43 [auto1.fr] INFO: Found listing with ID: LS55707
2026-03-30 12:30:43 [auto1.fr] INFO: Found listing with ID: GA79077
2026-03-30 12:30:43 [auto1.fr] INFO: Found listing with ID: LR46598
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LR46598%27 HTTP/1.1" 200 None
2026-03-30 12:30:43 [auto1.fr] INFO: Scrape type for LR46598: 2
2026-03-30 12:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91648fce-09fd-5dea-bcd7-1ae5fcfcd961 with identifier: LR46598
2026-03-30 12:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91648fce-09fd-5dea-bcd7-1ae5fcfcd961 with scrape type 2
2026-03-30 12:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91648fce-09fd-5dea-bcd7-1ae5fcfcd961 with scrape type 2
2026-03-30 12:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 91648fce-09fd-5dea-bcd7-1ae5fcfcd961, identifier: LR46598
2026-03-30 12:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 91648fce-09fd-5dea-bcd7-1ae5fcfcd961 with identifier: LR46598
2026-03-30 12:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 91648fce-09fd-5dea-bcd7-1ae5fcfcd961 with identifier: LR46598
2026-03-30 12:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 91648fce-09fd-5dea-bcd7-1ae5fcfcd961 with identifier: LR46598 to the API
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:20:39Z',
'fuel_type': 'diesel',
'id': '91648fce-09fd-5dea-bcd7-1ae5fcfcd961',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR46598',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 160971,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-31',
'seller_name': None,
'title': 'Toyota RAV 4 2.2 D-4D Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2015}
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LR46598%27 HTTP/1.1" 200 None
2026-03-30 12:30:43 [auto1.fr] INFO: Saving data for LR46598: {'auction_closing_time': 1774884039.0, 'created_time': 1774696367.987784, 'last_price_update_time': 1774873843.930229}
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LR46598') HTTP/1.1" 204 0
2026-03-30 12:30:44 [auto1.fr] INFO: Found listing with ID: PL44219
2026-03-30 12:30:44 [auto1.fr] INFO: Found listing with ID: LS69033
2026-03-30 12:30:44 [auto1.fr] INFO: Found listing with ID: EY77781
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY77781%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.fr] INFO: Scrape type for EY77781: 2
2026-03-30 12:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f5d3582-b39a-5313-a7b0-8b4df8725a0a with identifier: EY77781
2026-03-30 12:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f5d3582-b39a-5313-a7b0-8b4df8725a0a with scrape type 2
2026-03-30 12:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f5d3582-b39a-5313-a7b0-8b4df8725a0a with scrape type 2
2026-03-30 12:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5f5d3582-b39a-5313-a7b0-8b4df8725a0a, identifier: EY77781
2026-03-30 12:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5f5d3582-b39a-5313-a7b0-8b4df8725a0a with identifier: EY77781
2026-03-30 12:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5f5d3582-b39a-5313-a7b0-8b4df8725a0a with identifier: EY77781
2026-03-30 12:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5f5d3582-b39a-5313-a7b0-8b4df8725a0a with identifier: EY77781 to the API
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:31:56Z',
'fuel_type': 'hybrid',
'id': '5f5d3582-b39a-5313-a7b0-8b4df8725a0a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY77781',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 100173,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-12',
'seller_name': None,
'title': 'Toyota Yaris 1.5 Hybrid Dynamic',
'transmission': 'automatic',
'trim': 'Dynamic',
'year': 2017}
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY77781%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.fr] INFO: Saving data for EY77781: {'auction_closing_time': 1774884716.0, 'created_time': 1774696375.223422, 'last_price_update_time': 1774873844.465217}
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EY77781') HTTP/1.1" 204 0
2026-03-30 12:30:44 [auto1.fr] INFO: Found listing with ID: WS01750
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS01750%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.fr] INFO: Scrape type for WS01750: 2
2026-03-30 12:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae1759cf-b81b-5021-ad7b-fc09222b1428 with identifier: WS01750
2026-03-30 12:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae1759cf-b81b-5021-ad7b-fc09222b1428 with scrape type 2
2026-03-30 12:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae1759cf-b81b-5021-ad7b-fc09222b1428 with scrape type 2
2026-03-30 12:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ae1759cf-b81b-5021-ad7b-fc09222b1428, identifier: WS01750
2026-03-30 12:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ae1759cf-b81b-5021-ad7b-fc09222b1428 with identifier: WS01750
2026-03-30 12:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ae1759cf-b81b-5021-ad7b-fc09222b1428 with identifier: WS01750
2026-03-30 12:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ae1759cf-b81b-5021-ad7b-fc09222b1428 with identifier: WS01750 to the API
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:44:27Z',
'fuel_type': 'petrol',
'id': 'ae1759cf-b81b-5021-ad7b-fc09222b1428',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS01750',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 169959,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-03',
'seller_name': None,
'title': 'Ford C-Max 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS01750%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.fr] INFO: Saving data for WS01750: {'auction_closing_time': 1774885467.0, 'created_time': 1773414328.758903, 'last_price_update_time': 1774873844.877379}
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WS01750') HTTP/1.1" 204 0
2026-03-30 12:30:44 [auto1.fr] INFO: Found listing with ID: EJ43664
2026-03-30 12:30:44 [auto1.fr] INFO: Found listing with ID: BY88788
2026-03-30 12:30:44 [auto1.fr] INFO: Found listing with ID: RK17685
2026-03-30 12:30:44 [auto1.fr] INFO: Found listing with ID: KA97981
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA97981%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.fr] INFO: Scrape type for KA97981: 2
2026-03-30 12:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55e608ef-cce8-5126-b7c8-c63b55bda70b with identifier: KA97981
2026-03-30 12:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55e608ef-cce8-5126-b7c8-c63b55bda70b with scrape type 2
2026-03-30 12:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55e608ef-cce8-5126-b7c8-c63b55bda70b with scrape type 2
2026-03-30 12:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 55e608ef-cce8-5126-b7c8-c63b55bda70b, identifier: KA97981
2026-03-30 12:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 55e608ef-cce8-5126-b7c8-c63b55bda70b with identifier: KA97981
2026-03-30 12:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 55e608ef-cce8-5126-b7c8-c63b55bda70b with identifier: KA97981
2026-03-30 12:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 55e608ef-cce8-5126-b7c8-c63b55bda70b with identifier: KA97981 to the API
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:06:48Z',
'fuel_type': 'diesel',
'id': '55e608ef-cce8-5126-b7c8-c63b55bda70b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA97981',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 261934,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-28',
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 1.6 HDi Ambiance',
'transmission': 'automatic',
'trim': 'Ambiance',
'year': 2009}
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA97981%27 HTTP/1.1" 200 None
2026-03-30 12:30:45 [auto1.fr] INFO: Saving data for KA97981: {'auction_closing_time': 1774883208.0, 'created_time': 1774452023.703479, 'last_price_update_time': 1774873845.30597}
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KA97981') HTTP/1.1" 204 0
2026-03-30 12:30:45 [auto1.fr] INFO: Channel: 24h | Page: 143 | totalHits: 5772 | hits on page: 40
2026-03-30 12:30:45 [auto1.fr] INFO: Found listing with ID: RF85983
2026-03-30 12:30:45 [auto1.fr] INFO: Found listing with ID: RF85983
2026-03-30 12:30:45 [auto1.fr] INFO: Found listing with ID: UA85826
2026-03-30 12:30:45 [auto1.fr] INFO: Found listing with ID: VS85106
2026-03-30 12:30:45 [auto1.fr] INFO: Found listing with ID: BX49552
2026-03-30 12:30:45 [auto1.fr] INFO: Found listing with ID: SH16233
2026-03-30 12:30:45 [auto1.fr] INFO: Found listing with ID: ZX43488
2026-03-30 12:30:45 [auto1.fr] INFO: Found listing with ID: YP68007
2026-03-30 12:30:45 [auto1.fr] INFO: Found listing with ID: VR32762
2026-03-30 12:30:45 [auto1.fr] INFO: Found listing with ID: TV44498
2026-03-30 12:30:45 [auto1.fr] INFO: Found listing with ID: AN79186
2026-03-30 12:30:45 [auto1.fr] INFO: Found listing with ID: RV86348
2026-03-30 12:30:45 [auto1.fr] INFO: Found listing with ID: SV52781
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV52781%27 HTTP/1.1" 200 None
2026-03-30 12:30:45 [auto1.fr] INFO: Scrape type for SV52781: 2
2026-03-30 12:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bdf9d4d-9e8c-59c0-ad30-fc27f7ccad9c with identifier: SV52781
2026-03-30 12:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bdf9d4d-9e8c-59c0-ad30-fc27f7ccad9c with scrape type 2
2026-03-30 12:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bdf9d4d-9e8c-59c0-ad30-fc27f7ccad9c with scrape type 2
2026-03-30 12:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5bdf9d4d-9e8c-59c0-ad30-fc27f7ccad9c, identifier: SV52781
2026-03-30 12:30:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5bdf9d4d-9e8c-59c0-ad30-fc27f7ccad9c with identifier: SV52781
2026-03-30 12:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5bdf9d4d-9e8c-59c0-ad30-fc27f7ccad9c with identifier: SV52781
2026-03-30 12:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5bdf9d4d-9e8c-59c0-ad30-fc27f7ccad9c with identifier: SV52781 to the API
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:19:25Z',
'fuel_type': 'diesel',
'id': '5bdf9d4d-9e8c-59c0-ad30-fc27f7ccad9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV52781',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Kona',
'odometer': 191623,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-23',
'seller_name': None,
'title': 'Hyundai Kona 1.6 CRDi Executive 4WD',
'transmission': 'automatic',
'trim': 'Executive 4WD',
'year': 2020}
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV52781%27 HTTP/1.1" 200 None
2026-03-30 12:30:45 [auto1.fr] INFO: Saving data for SV52781: {'auction_closing_time': 1774883965.0, 'created_time': 1774696373.568934, 'last_price_update_time': 1774873845.727039}
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SV52781') HTTP/1.1" 204 0
2026-03-30 12:30:45 [auto1.fr] INFO: Found listing with ID: ZS14692
2026-03-30 12:30:45 [auto1.fr] INFO: Found listing with ID: ME66305
2026-03-30 12:30:45 [auto1.fr] INFO: Found listing with ID: RR61665
2026-03-30 12:30:45 [auto1.fr] INFO: Found listing with ID: EE16468
2026-03-30 12:30:45 [auto1.fr] INFO: Found listing with ID: BS02300
2026-03-30 12:30:45 [auto1.fr] INFO: Found listing with ID: TZ57976
2026-03-30 12:30:45 [auto1.fr] INFO: Found listing with ID: PF75410
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF75410%27 HTTP/1.1" 200 None
2026-03-30 12:30:45 [auto1.fr] INFO: Scrape type for PF75410: 2
2026-03-30 12:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b3f4267-8199-5f05-a0bc-8df77194daa0 with identifier: PF75410
2026-03-30 12:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b3f4267-8199-5f05-a0bc-8df77194daa0 with scrape type 2
2026-03-30 12:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b3f4267-8199-5f05-a0bc-8df77194daa0 with scrape type 2
2026-03-30 12:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7b3f4267-8199-5f05-a0bc-8df77194daa0, identifier: PF75410
2026-03-30 12:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7b3f4267-8199-5f05-a0bc-8df77194daa0 with identifier: PF75410
2026-03-30 12:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7b3f4267-8199-5f05-a0bc-8df77194daa0 with identifier: PF75410
2026-03-30 12:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7b3f4267-8199-5f05-a0bc-8df77194daa0 with identifier: PF75410 to the API
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:20:01Z',
'fuel_type': 'diesel',
'id': '7b3f4267-8199-5f05-a0bc-8df77194daa0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF75410',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 181411,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-07-02',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 170 CDI Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2002}
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF75410%27 HTTP/1.1" 200 None
2026-03-30 12:30:46 [auto1.fr] INFO: Saving data for PF75410: {'auction_closing_time': 1774884001.0, 'created_time': 1774696372.334734, 'last_price_update_time': 1774873846.245661}
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PF75410') HTTP/1.1" 204 0
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: RN12409
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: DJ06315
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: KE79692
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: MR02960
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR02960%27 HTTP/1.1" 200 None
2026-03-30 12:30:46 [auto1.fr] INFO: Scrape type for MR02960: 0
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: ED20570
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: GU66594
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: RW22841
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: SR33395
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR33395%27 HTTP/1.1" 200 None
2026-03-30 12:30:46 [auto1.fr] INFO: Scrape type for SR33395: 0
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: RM54731
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM54731%27 HTTP/1.1" 200 None
2026-03-30 12:30:46 [auto1.fr] INFO: Scrape type for RM54731: 2
2026-03-30 12:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8228c4bd-0a1f-5864-b49a-8e24f04506fa with identifier: RM54731
2026-03-30 12:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8228c4bd-0a1f-5864-b49a-8e24f04506fa with scrape type 2
2026-03-30 12:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8228c4bd-0a1f-5864-b49a-8e24f04506fa with scrape type 2
2026-03-30 12:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8228c4bd-0a1f-5864-b49a-8e24f04506fa, identifier: RM54731
2026-03-30 12:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8228c4bd-0a1f-5864-b49a-8e24f04506fa with identifier: RM54731
2026-03-30 12:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8228c4bd-0a1f-5864-b49a-8e24f04506fa with identifier: RM54731
2026-03-30 12:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8228c4bd-0a1f-5864-b49a-8e24f04506fa with identifier: RM54731 to the API
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:27:05Z',
'fuel_type': 'petrol',
'id': '8228c4bd-0a1f-5864-b49a-8e24f04506fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM54731',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 112848,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-27',
'seller_name': None,
'title': 'Renault Captur 0.9 TCe Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2019}
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM54731%27 HTTP/1.1" 200 None
2026-03-30 12:30:46 [auto1.fr] INFO: Saving data for RM54731: {'auction_closing_time': 1774884425.0, 'created_time': 1773832146.639316, 'last_price_update_time': 1774873846.71683}
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RM54731') HTTP/1.1" 204 0
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: BA15313
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BA15313%27 HTTP/1.1" 200 None
2026-03-30 12:30:46 [auto1.fr] INFO: Scrape type for BA15313: 0
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: GP40484
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: TV53253
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: VZ28083
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: PW73180
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: ZJ79547
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: GU88043
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: CJ89018
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: VB72457
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: VW62439
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: BX37625
2026-03-30 12:30:46 [auto1.fr] INFO: Found listing with ID: EM16209
2026-03-30 12:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:49 [auto1.fr] INFO: Channel: 24h | Page: 144 | totalHits: 5772 | hits on page: 40
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: XH38409
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: YZ66833
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: DZ35713
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: SN51448
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN51448%27 HTTP/1.1" 200 None
2026-03-30 12:30:49 [auto1.fr] INFO: Scrape type for SN51448: 0
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: RA20352
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: VJ77533
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: WE49273
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: LF63766
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: YN81536
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: UL15544
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: YE09029
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE09029%27 HTTP/1.1" 200 None
2026-03-30 12:30:49 [auto1.fr] INFO: Scrape type for YE09029: 0
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: UK37491
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK37491%27 HTTP/1.1" 200 None
2026-03-30 12:30:49 [auto1.fr] INFO: Scrape type for UK37491: 0
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: RX46626
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: FZ99237
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: XX72122
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XX72122%27 HTTP/1.1" 200 None
2026-03-30 12:30:49 [auto1.fr] INFO: Scrape type for XX72122: 0
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: WL85803
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: ZV75973
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: LZ28528
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: EG43266
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: KD89517
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD89517%27 HTTP/1.1" 200 None
2026-03-30 12:30:49 [auto1.fr] INFO: Scrape type for KD89517: 0
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: YJ96887
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: KV42540
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: GE66924
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: LL38943
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: DU16102
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU16102%27 HTTP/1.1" 200 None
2026-03-30 12:30:49 [auto1.fr] INFO: Scrape type for DU16102: 0
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: JJ05514
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: PT09223
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: MW07516
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: UT37914
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: VV87266
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: AZ74891
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: CE94312
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE94312%27 HTTP/1.1" 200 None
2026-03-30 12:30:49 [auto1.fr] INFO: Scrape type for CE94312: 0
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: LV79530
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: VM42744
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: XV92710
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV92710%27 HTTP/1.1" 200 None
2026-03-30 12:30:49 [auto1.fr] INFO: Scrape type for XV92710: 0
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: KF84631
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: RB38317
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: JL17246
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: ZG41489
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: MA29891
2026-03-30 12:30:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:05 [scrapy.extensions.logstats] INFO: Crawled 392 pages (at 7 pages/min), scraped 319 items (at 62 items/min)
2026-03-30 12:31:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-30 12:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:25 [auto1.fr] INFO: Channel: 24h | Page: 145 | totalHits: 5773 | hits on page: 13
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: MA29891
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: HD06646
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: WA81250
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: NR86231
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: DE98680
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: NG50489
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: EX61792
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: GY01247
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: NL00727
2026-03-30 12:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL00727%27 HTTP/1.1" 200 None
2026-03-30 12:31:25 [auto1.fr] INFO: Scrape type for NL00727: 0
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: GR49383
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: HT46359
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: WB27977
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: LS63688
2026-03-30 12:31:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:46 [auto1.fr] INFO: Channel: 24h | Page: 146 | totalHits: 5774 | hits on page: 0
2026-03-30 12:31:46 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 12:31:46 [auto1.fr] INFO: auto1.fr Batch config: batch 2/4
2026-03-30 12:31:46 [auto1.fr] INFO: auto1.fr Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 10, <ScrapeType.BATCH_SKIPPED: 5>: 55}
2026-03-30 12:31:46 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (319 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.fr/task_13_2026-03-30T11_05_00.jl
2026-03-30 12:31:46 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1815781,
'downloader/request_count': 938,
'downloader/request_method_count/GET': 789,
'downloader/request_method_count/POST': 149,
'downloader/response_bytes': 100901717,
'downloader/response_count': 938,
'downloader/response_status_count/200': 937,
'downloader/response_status_count/401': 1,
'dupefilter/filtered': 9,
'elapsed_time_seconds': 5201.148124,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 30, 12, 31, 46, 188437, tzinfo=datetime.timezone.utc),
'item_scraped_count': 319,
'log_count/DEBUG': 11204,
'log_count/INFO': 14677,
'log_count/WARNING': 1,
'memusage/max': 185012224,
'memusage/startup': 147935232,
'photo_download_count': 544,
'request_depth_max': 151,
'response_received_count': 394,
'scheduler/dequeued': 938,
'scheduler/dequeued/memory': 938,
'scheduler/enqueued': 938,
'scheduler/enqueued/memory': 938,
'scrape_type/batch_skipped': 4364,
'scrape_type/new': 121,
'scrape_type/price_update': 198,
'scrape_type/skipped': 1121,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 448,
'scrapy-zyte-api/error_ratio': 0.12053571428571429,
'scrapy-zyte-api/errors': 54,
"scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 54,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 12.315130217314032,
'scrapy-zyte-api/mean_response_seconds': 12.380139699905433,
'scrapy-zyte-api/processed': 394,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 394,
'scrapy-zyte-api/request_args/experimental.requestCookies': 393,
'scrapy-zyte-api/request_args/experimental.responseCookies': 394,
'scrapy-zyte-api/request_args/httpRequestBody': 149,
'scrapy-zyte-api/request_args/httpRequestMethod': 149,
'scrapy-zyte-api/request_args/httpResponseBody': 394,
'scrapy-zyte-api/request_args/httpResponseHeaders': 394,
'scrapy-zyte-api/request_args/sessionContext': 394,
'scrapy-zyte-api/request_args/url': 394,
'scrapy-zyte-api/status_codes/0': 54,
'scrapy-zyte-api/status_codes/200': 394,
'scrapy-zyte-api/success': 394,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'source/items_encountered': 5813,
'source/total_available': 5774,
'start_time': datetime.datetime(2026, 3, 30, 11, 5, 5, 40313, tzinfo=datetime.timezone.utc)}
2026-03-30 12:31:46 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 12:31:46 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f073a536590>
2026-03-30 12:31:46 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f073a684310>
PROJECT (sourcing_v2)
SPIDER (auto1.fr)
Press to refresh